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o a r\c GROUND OF THE INVENTION 
^ "en— 

having a plurality of switching devices arranged tn a nng topology an 
an output queuing controlled packet transfer protocol. 

Description ofthe Prior Art: „ mB ofdaa communication networks including local 

Switching devices are essentral components of data co ^ 
u utwprNFT and wide areanetworKs ^wai^;. 

Cross bar g interconnection resources requiring a 

output ports, and a switching matnx having One problem with 

omnlexitv of NxN for selectively connecting the input ports to the output ports. 



10 



15 



20 



25 



order to increase the numb ,f network connections for «he switch. >wever, prior art packe, 
switching fabrics usually have a bus topology including a back plane, or bus, having a plurahty of 
slott, for cards including the network port, One problem with such switching devices is modulanty. 
While a number of cards having additional network ports may be inserted into slots of the back 
plane to increase .he total number of network ports, the maximum number of cards wluch may be 
added is limited because the back plane may support only a limited number of cards due ,0 loadmg 
effects on the back plane. Therefore, the modularity problem of bus architecture packe, swttchtng 
fabrics imposes a limit on the scalability of the number of network ports of the fabnc. 

Typically each device of a switching fabric includes a plurality of switching devices each 
including: network ports for transmitting and receiving dam packets to and from network nodes v,a 
network communication links; and internal data link ports for transmitting and receiving data 
packets to and from other switch devices of the fabric. The switching devices of a switchmg fabnc 
may be configured in any one of a variety of topologies, or architectures. In a switching fabnc 
having a ring architecture, the devices are configured in a ring topology. Because each connectton 
in a ring architecture switching fabric is a point to point link, ring architecture switching fabncs 
al low for higher frequencies and greater throughput between devices than bus architecture fabnc. 
Typical prior art ring architecture switching fabrics are controlled by a token ring protocol 
wherein only one device of the ring transmits data a. a time. Therefore, prior art ring archttecture 
switching fabrics are not commonly used for network switching which requires htgh data 
rhroughput. An important objective of the present invention is to provide a ring architecture packet 
switching fabric which is capable of concurrently processing an increased number of packe, transfer 
operations between a large number of source network nodes and conesponding destination network 
nodes, thereby allowing for greater switching throughput. 

Each switching device of a switching fabric reads header information of a data packet, 
received from a source node via one of to network ports, in order to dynamicai.y route the data 
packe, to an appropriate destination network port, or ports, which is communicattvely to a 
destination node specified by a destination address carried in the header information of the data 
packet The destination network port may be a local network port of the same switching dev.ee, 
having the source port at which the packet is received, or maybe a network port of another 
switching device of the fabric. The process of transferring a data packet received a. a network port 
of a source device to a network port of a destination device is referred to herein as a packet transfer 
operation. In order to transfer data from a source device to a destination device, an interna, source- 
destination channel path coupling the source port ,o the destination port is requtred. 



Inm anydatacom„. iarions networks, and Pearly in i d area networks^., 
signal. Therefore, transrms^on of a data packet 

allowing for an increased number of network ports ^ 

S wi,eh lng devrces of ,h fabrtc *er by g ^ ^ 

device and a corresponding destination port. Achieving j ed 
provides a packet switching fabric wherein each switching dev.ce of the fabric has an 
20 number of ports. 

SUMMARY OF THE INVENTION ^ 
Itisanobjectofthepresentinventiontoprovideanngarc r 

device and a corresponding destination port. 



Ye, another objeet he present invention is to provide a p, t switehing fabric whieh 
provides redueed delays in packe, transfer operations, and therefore faster swi.ch.ng. 

Briefly a presently preferred embodiment of me present invention compnses a packet 
switching fabric inc.uding means forming a data ring, means forming a control ring, and means 
forming a plurality of dam communication network link, each having a. leas, one network node 
coupled thereto. The packe, switching fabric tather includes a plurality of output queumg 
conLed switching devices coup.ed together by the data ring means and the control rmg means so 
that the network links can be selectively communicatively coupled. 

Each of the switching devices includes: data ring processing means for transmrmng and 
receivingbursts of data to and from adjacent ones of the devices via the data ring means; network 
interface means having a. leas, one network port for transmuting and receiving data packets to and 
tarn me network links; and packet buffer means for storing me received data packets. 

Each of the switching devices further includes: source managing means commumcafvely 
coupled to the date ring processing means, and providing an interface between the network mterface 
nJL and the packe, buffer means, the source managing means being operatrve to deveiop 
information for storing and reading each one of the received data packe. ,o and from dre packe 
buffer means, and also being operative ,o develop destination identifrcation informal , assocated 
with each one of ,he received date packcs, me destination identification informaflon mdrcating an 
associa,ed des,ina,ion one of me network ports of an associated destination one of.be devrces, ,he 
rec eived date packcs including tiansfer packe* received a. an associa.ed source one of tine devrces 
fa, is differen. from tire associated des.ina.ion device, and local packcs for which tire assocrated 
destination ne,work por, is a port of tire associa,ed source device, tire pointer information and 
destination identifrcation information associated witir each one of «he local packcs provrdmg local 
announcement information serving as a local request for access to tire associated tie— 
ncwork port, tire pointer information and destination identification information assocrated wrth 
each one of tire transfer packcs providing tiansfer announcemen, information; control rmg 
processing means responsive to the transfer announcemen. information, and operauve to tiansm,, 
and receive conttol messages .o and from adjacen, ones of the devices via tine control nng means, 
,he conteo, messages including announcemen, messages each being associated with one of tire 
J transfer packets and carrying tire associated transfer announcemen, information, the control nng 
processing means also being operative ,o provide received transfer amrouncemen, informatron m 
response ,o each received one of tire announcemen, messages, tire received teansfer announcemen, 
information serving as a remote request for access to the associated destination network port; and 
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destination managing me* ommunicatively coupled to the netwo nterface means, and 
responsive to the local announcement information and the received transfer announcement 
information, and operative to arbitrate between competing ones of the local and remote requests for 
access to each of the network ports, and also operative to generate transfer notification information 
associated with selected ones of the transfer data packets. 

The control messages further include transfer notification messages developed by the control 
ring processing means in response to the transfer notification information, each the notification 
message being associated with one of the transfer data packets and carrying source identification 
information indicative of the associated source device, each the notification message indicating to 
the associated source device that the associated selected transfer data packet has been granted 
access to the associated destination network port. 

The network interface means includes a plurality of transmit buffer queues each providing 
for receiving data from the destination managing means, and for transmitting bursts of data to a 
corresponding one of the network links via a corresponding one of the network ports. 

The destination managing means includes an output buffer manager for monitoring the 
availability of buffer space in each of the transmit buffer queues, and wherein each of the 
notification messages is transferred via the control ring means after a determination by the output 
buffer manager that an associated destination one of the transmit buffer queues, that is connected to 
the associated destination network port, includes a threshold amount of available buffer space. 

The output buffer manager is operative to determine a number of blocks of buffer space 
available at each of the transmit buffer queues, each of the available blocks providing buffer space 
sufficient for receiving a burst of packet data from the destination managing means. 

The notification information further comprises an initial channel credit value indicating of a 
number of available blocks at the destination transmit buffer queue associated with the selected 
25 transfer data packet prior to transmitting the associated notification message. 

The data ring means includes a plurality of data ring segments each coupling a 
corresponding adjacent pair of the devices together. The packet buffer means includes at least one 
memory unit communicatively coupled with the source managing means via a corresponding 
memory unit link. Each of the devices is responsive to a channel resource patrol message received 
30 from an adjacent one of the devices, the patrol message carrying channel bandwidth information 

including a plurality of data ring segment bandwidth parameters each being indicative of an amount 
of bandwidth currently available at a corresponding one of the data ring segments, and a plurality of 
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m emory unit link bandwid ,arameters each being indicative of an .ount of bandwidth currently 
available at a corresponding one of the memory unit links. 

The control ring processing means is responsive to the channel bandwidth information, and 
operative to read and modify the channel bandwidth information for the purpose of managing data 
5 transfer via corresponding ones of a plurality of source-destination channel paths for transmitting 
associated ones of the selected transfer data packets from the associated source device to the 
associated destination device, each of the paths including corresponding ones of the data nng 
segments and a corresponding one of the memory unit links. 

An important advantage of the packet switching fabric of the present invention is that it 
10 provides reduced delays in packet transfer operations, and therefore faster switching operations. 

The foregoing and other objects, features, and advantages of the present invention will be 
apparent from the following detailed description of the preferred embodiment which makes 
reference to the several figures of the drawing. 

15 IN THE DRAWING: 

FIG 1 is a schematic block diagram of a packet switching fabric according to the present 
invention including a plurality of switching devices arranged in a ring topology and intercoupled via 
a data ring, and a control ring which provides for implementing an output queuing controlled 
protocol for managing the data transfer capacity of the data ring; 

20 ' FIG. 2A is a generalized block diagram of a cut-through packet transfer switching device of 

the packet switching fabric of FIG. 1 ; 

FIG. 2B is a generalized block diagram of a high speed network port switching device of the 

packet switching fabric of FIG. 1 ; 

FIGS. 3 A and 3B are detailed schematic circuit block diagrams of the switching devices of 
25 FIGS. 2A and 2B respectively, both of the devices including a data ring processing circuit, a control 
ring processing circuit, a source managing unit having a source channel control unit, and a 

destination managing unit; 

FIG. 3C is a circuit block diagram depicting further details of the source channel control unit 

of one of the switching devices of FIGS. 3 A and 3B; 
30 FIGS. 4A through 4E are block diagrams depicting field structures of control messages 

transmitted via the control ring of FIG. 1 for implementing the output queuing controlled packet 
transfer protocol of the present invention; 
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FIGS SAandSBa. .lock diagrams depicting source and d nation identification tables 
respectively for mapping source and destination identification values to corresponding ones of the 
switching devices and network ports of the switching devices; 

FIG. 6 is a block diagram depicting a field structure of a channel resource patrol message (or 
token message) transmitted via the data ring of FIG. 1, the patrol message including channel 

bandwidth information indicative of available bandwidth resources for transmitting bursts of 
data between the switching devices via the data ring; 

FIG. 7 is a block diagram depicting a field structure of a packet transfer initialization 
message transmitted via the data ring of FIG. 1 for use in multicast packet transfer operations; 

FIG 8 is a flow diagram illustrating a source device managing process performed by the 
source managing unit of a source one of the switching devices in response to receiving a data packet 
via a network port of the source switching device; 

FIG 9A is a flow diagram illustrating a destination device managing process performed by 
the destination managing unit of a destination one of the switching devices in response to receiving 
1 5 a unicast packet location announcement (PLA) message; 

FIGS 9B is a flow diagram illustrating a destination device managing process performed by 
the destination managing unit of a destination one of the switching devices in response to receiving 

a multicast PLA message; 

FIGS 10A through 10C are flow diagrams illustrating a destination device arbitration 
process performed by the destination managing unit of a destination one of the switching devices in 
accordance with the output queuing controlled packet transfer protocol of the present inventton; 

FIGS. 1 1 A and 1 IB are flow diagrams illustrating a packet transfer process performed by 
the source managing unit of a source switching device in response to receiving a packet transfer 
notification (PTN) message from a corresponding destination switching device; 

FIG. 12 is a flow diagram illustrating a process performed by the source managing unit of a 
source switching device in response to receiving an incremental credit transfer message from a 
corresponding destination switching device; and 

FIG. 13 is a flow diagram illustrating a process performed by the source managing unit of a 
source switching device in response to receiving an incremental rate transfer message from a 
30 corresponding destination switching device. 
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DETAILED DESCRIPTIC OF THE PREFERRED EMBODIME. 3 

FIG 1 shows a schematic block diagram of a packet switching fabric a, 10 accordtng to the 
pr esen, invention, the fabric .0 inching three cn.-ti.ongh packe, transfer switching devtces 12, 
designated SWITCH 0, SWITCH.!, and SW1TCH_2, each having: eigh, network ports .4 
7 , H.AO Al " AT) (BO Bl B7), and (CO, CI C7) respectively for transmitting and 

da. ring messages from an npsueam device via a corresponding one of a plural.* of 33-b. to 
ring seglen. ,8; a da, ring on.pn. port 20 connected to — data and data nng message* to a 
10 coLponding downs.ean, device via a corresponding one of tire data ring segments I a conno 
„g Jpu, pon 22 for receiving conho, messages, which include ontpnt q nening conned pac e« 
Jsfe plco. mesaages, from tire corresponding npstream device via a correspondmg one of a 

LroLessages to tire corresponding downsfream device via a correspondmg one oftite control 
„ 24. rhedararingsegmentsISfomtadararing.P.andtiaecon.oinngaegments 

24 form a control ring 25 for interconpling the switching devices as described above. 

The packer switching fabric ,0 a,so inchtdes a high speed network port swrtchtng dev.ce 30, 
designated SWITCH 3, having: two high speed network ports 32 designated DO and D, for 

20 data ring inpnt port 34 for receiving data and data ring messages from the upstream devtce 
" SWITCH 2 via a corresponding one of the data ring segments 18; a data nng output port 36 
connected"* transmit da. and da, ring messages ,o a corresponding downstream device vta a 
corresponding one of ,he data ring segments; a control ring input port 38 for recetvtng contro 
messages from the corresponding upstream device via a corresponding one oftite control nng 
25 segments 24; and a control ring output port 40 connected to transmit control messages to the 
corresponding downstream device via a corresponding one oftite control ring segment. 

The packe, switching fabric 10 further includes: a dedicated ring management devtce 42 
having a data ring inpu, port 44 for receiving data and da. ring messages from the correspondmg 
npstream device, SWITCH* via a corresponding one of tire da. ring segments 18, a data nng 
30 output port 46 connected ,o transmit data and data ring messages ,o the correspondmg do- 
device SWITCH 1, via a corresponding one of the da. ring segments, a control nng mput port 48 
for receiving connol messages from the upstrean, device, SWITCH.3, via a corresponding one of 
the control ring segments 24, and a control ring output port 46 connected to transmu control 



messages to the downstreai evice via a corresponding one of the c rol ring segments; a central 
processing unit 51 communicatively coupled with the management device 42 via a CPU link 52; a 
first high function memory unit 54 designated MEMORY_A communicatively coupled with the 
management device 42 via a first memory unit link 55; and a second high function memory unit 56 

5 designated MEMORY_B communicatively coupled with the management device 42 via a second 
memory unit link 57. The bandwidth, or data transfer capacity, of the CPU link 52 depends on the 
bandwidth of the bus of the CPU. 

In one embodiment, each of the data ring segments 18 is 33 bits wide and is used for 
transmitting data channel link signals which are clocked at 66 MHz. The total bandwidth for 

10 signals transmitted via each data ring segment is 3.2 Gbps. Each of the control ring segments 24 of 
the fabric is nine-bits wide and is used for transmitting control ring signals which are also clocked at 
66 MHz. 

Packet transfer operations executed in the switching fabric 10 (FIG. 1) include: local packet 
transfer operations wherein a data packet is received and transmitted from network ports 14 or 32 of 

15 the same switching device; and remote packet transfer operations wherein a data packet is received 
at a network port 14 or 32 of a source one of the switching devices and transmitted from a network 
port of a destination one of the switching devices that is communicatively coupled to the source 
device via the data ring 19 and control ring 25. Also, as further explained below, the local and 
remote packet transfer operations may be either unicast or multicast operations. 

20 FIG. 2A shows a generalized block diagram illustrating components of one of the cut- 

through packet transfer switching devices 12 of the packet switching fabric 10 (FIG. 1) of the 
present invention. In one embodiment of the present invention, each of the switching devices 12 is 
implemented by an application specific integrated circuit (ASIC). In the depicted embodiment, the 
switching device 12 includes: a control ring processing circuit 60 for receiving control ring 

25 messages via the control ring input port 22 of the switching device as generally illustrated by a line 
62, and for providing control ring messages to the control ring output port 26 of the switching 
device as generally illustrated by a line 64; a data ring processing circuit 66 for receiving data 
packet bursts and data ring messages via the data ring input port 16 of the switching device as 
illustrated by a line 68, and for providing data packet bursts and data ring messages to the data ring 

30 output port 20 of the switching device as illustrated by a line 70, and being communicatively 
coupled with the control ring processing circuit 60 as illustrated by a line 72; a destination 
managing unit 74 communicatively coupled with the control ring processing circuit 60 as illustrated 
by a line 76, and also being communicatively coupled with the data ring processing circuit 66 as 



illustrated by a line 78; a n. ork interface circuit including a plural of N transmit buffer queues 
80 for receiving data packet bursts from the device destination managing sub-system 74 as 
generally illustrated by a plurality of N lines 82, and for providing packet data to a corresponding 
one of N network output ports 84 designated AO', Al',.., A7\ a plurality of N receive buffer 
queues 86 for receiving packet data via a corresponding one of a plurality of N network input ports 
88 designated AO", Al A7"; a source managing unit 90 communicatively coupled with the 
control ring processing circuit 60 as illustrated by a line 92, and also being communicatively 
coupled with the data ring processing circuit 66 and the device destination managing unit 74 as 
generally illustrated by lines 94 and 96 respectively, and being further coupled to receive packet 
data from the receive buffer queues 86 as illustrated by a plurality of lines 98; and a packet buffer 
100 having a plurality of memory units. 

The packet buffer 100 provides for storing data packets received via the network input ports 
88. In the depicted embodiment, the packet buffer 100 includes: a first memory unit 102 
communicatively coupled with the source managing unit 90 via a first memory unit link 103; and a 
second memory unit 104 communicatively coupled with the source managing unit 90 via a second 
memory unit link 105. In alternative embodiments of the present invention, the packet buffer 100 
may include any number of memory units. Each of the memory units 102 and 104 is also 
communicatively coupled to receive control signals from the source managing unit 90 as generally 
illustrated by a line 106, the control signals for accessing specified packet data stored in the memory 
units 102 and 104. In one embodiment of the present invention, the external packet buffer 100 is 
not implemented on the ASIC which is used to implement the other components of the depicted 
switching device. Further, in the preferred embodiment, the memory units 102 and 104 of the 
external packet buffer 100 are implemented by dynamic RAM (DRAM) memory units. 

The eight network input ports 86 designated AO", Al",..., A7", and corresponding eight 
network output ports 80 designated AO', Al ',..., A7' are implemented by the eight network bi- 
directional ports 14 designated AO, Al,..., A7 (FIG. 1). In one embodiment, each of the eight 
transmit buffer queues 80, and each of the eight receive buffer queues 86, is implemented by a first 
in-first out buffer (FIFO) which is limited in size in order to increase the integration level of the 
ASIC used to implement the switching device 12. Because each of the eight transmit buffer queues 
80 is limited in size, the transmit buffer queues 80 are too small to store a whole data packet. 
Because local area networks, such as ETHERNET, require uninterrupted transmission of a data 
packet to its destination node, the switching fabric 10 (FIG. 1) implements cut-through packet 
transfer through the lower and middle speed destination port transmit buffer queues 80 each of 

1 f\ 



10 



15 



20 



30 



which is connected to eithc 10 Mbps data communication link, ox .00 Mbps data 
communication link. In accordance with the cut-through packet transfer, while a data stream is 
being received at the data ring input 16 of the device 12 from an upstream source device, precedmg 
data of the same data stream is simultaneously transmitted from the appropriate one of network 
output ports 84 so that the corresponding one of the transmit queues 80 does not overflow or 
underflow. 

The control ring processing circuit 60 provides for receiving, developing, processing, and 
transmitting control messages including output queuing controlled packet transfer protocol 
messages between the devices via the control ring 25 (FIG. 1) in order to manage bandwidth 
resources of segments 18 of the data ring 19 (FIG. 1) and bandwidth resources of the memory unit 
links 103 105 (FIG. 2A) as data is transferred via the data ring from source ones of the switching 
devices to corresponding destination ones of the switching devices. The output queuing controlled 
protocol messages are used to dynamically allocate source-destination channels prior to beginning 
data transfer from a source device to a destination device. The amount of bandwidth allocated for 
each source-destination channel is commensurate with the network link capacity of the destination 
network port. As further described below, an appropriate amount of bandwidth is allocated for each 
source-destination channel path before the corresponding packet transfer operation begins so that 
the packet transfer will not be disturbed during its network transmission. 

Upon receiving a control message via the control ring input port 22, the control ring 
processing circuit 60 makes preliminary determinations including: reading a message type field of 
the message to determine the type of message received as further explained below; and comparing 
source and destination device ID fields of the message to a local device ID. When appropriate, as 
further explained below, the control ring processing circuit 60 transfers the message downstream 
via the control ring output port 26. Generally, if the destination of a control message received by a 
device is local, the control message is downloaded for local processing without being delivered 
downstream. Also generally, if the destination of a control message received by a device is not 
local, the message is propagated downstream. Each of the devices 12, 30, and 42 of the switching 
fabric 10 (FIG. 1) includes means for synchronizing and retiming messages received via its 
upstream device. 

The source managing unit 90 is operative to develop pointer information for storing and 
reading each one of the received data packets to and from the packet buffer means,and also 
operative to develop destination identification information associated with each one of the received 
data packets. The destination identification information indicates an associated destination one of 



th e network input ports 8 8 - associated destination one of the sv hing devices 12 and 30 (FIG. 
' » The received data packets include: transfer packets received at an associated source one of the 
devices rha, is different from tire associated destination device; and local packets for whtch the 
associated destination network port is a port of the associated source device. The pomter 
information and destination identification information associated with each one of the .oca, packets 
pmvide local announcement information serving as a .oca! request for access to tire associated 
destination network port. The pointer information and destination identification information 
associated with each one of the transfer packets provides transfer announcement information. 
The control ring processing circuit 60 is responsive to the transfer announcement 
, information, and operative to transmit and receive control messages to and from adjacent ones of 
me devices 12 and 30 (FIG. .) via the control ring 25 (FIG. 1), the control messages mcludmg a 
packer location —emeu, message (PLA message) associated wilh each one of me rece.ved 
data packets, each PLA message carrying corresponding announcement information and proving a 
req ues. to me associated destination switching device for access to the associated destination 
5 network port on behalf of the associated received data packet. The contro. ring processing urn. 60 
is also operative to provide received transfer announcement information in response to each 
received one of the announcement messages, the received transfer announcement information 
serving as a remote request for access to tire associated destination network port. 

The destination managing unit 74 is responsive to the .oca. announcement information and 
20 me received transfer announcement information, and operative to arbitrate between competing ones 
of the local and remote requests for access to each of the network ports 84. The destination 
managing unit 74 is also operative to generate transfer notification information associated wrth 

selected ones of the transfer data packets. 

The source managing unit 90 is operative ,0 access the received data packets stored ,n the 
25 packet buffer unit . 00 using pointer information associated with the received data packets. 

The announcement information associated with each one of the received data packets 
incudes the associated pointer information, source identification information indicating an 
associated source one of the devices 12 and 30 (FIG. 1) drat has received the associated rece.ved 
data packet, and destination identification information indicating the associated destination network 
30 port and the associated destination device. 

The contro. messages further include a packet transfer notification message (PTN message) 
developed by the control ring processing unit 60 in response to the notification information. The 
PTN message is transferred to the selected source device atwhiehthe se.ected data packet ,s stored. 
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The no,— message h — *a« the se.ected data paOte, has » granted access to dre 
destination port associated w«h .he selected £ , ^ ^ 

Tfce destination managmg urn, 74 „ ^« ^ ^ ^ ring 

in each of the transmit buffer queues 80. The PTN messag ^ ^ 

==r,r - — — 

dataracketincludesathresholdamountofavailablebufferspace. 

data packet, inci rest)ons ive to the packet transfer notification 

The control ring processing circuit 60 is responsive p messaees ) 
a ■ nnerative to develop packet transfer notification messages (PTN messages) 
information, and is operative d v lop P correspQnding source ones of the switching 

which are transmitted via the control ring 25 (Hb. I) to 

devices 12 and 30 (FIG. 1). the transmi ssion of bursts of data 

The source managing unit 90 is runner ope „v nmiP i 
from the pac k e, buffer unit ,00 ,o me dam ring processing circuit 66 m response to channe, 

below. The channel Ddiiu The control ring 

Ibices. The channe, bandwidth information carried by the patro, message mc,ud a a 

bandwidth currently available at a corresponding one of the data nng g 

of memory urn, m* banded* parameters each being indicative o, an ^ of 

Elected bandwidth parameter, whrch are associated with a seiected source-destt anon 

anTe path inCude: se.ected ones of a phrrahty of data ring segment bandwrdth parameters 
channel paxn, inn disposed between the source 
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processmgunitoOishurhc perativetodetermin earn— » > of bandwidth current,, 

available for the corresponding source-destination channel path. 

HO 2B shows a generalized block diagram illustrating components of the htgh speed 
FIG. 2B sho g iQ ^ In one embodiment of 

• -trASin The high speed network port switching device 30 is similar xo 

— idLces^cep,^,-,— r -^— 

32(no .i)for— .-«*rrj^Ciri-.--». 

« rTTG n the device 30 includes larger transmit buffer queues 1 10 wm F 

33 (KG. i;, me ucviw- j structure and function of 

the high spee excet3 t with respect to the larger transmit buffer 

device 12 (FIG. 3A) are practically identical, except wim v 

queues 110. ™ includes- two transmit buffer 

providing data «o the source managing 90, and - ,npu 

two high speed network input ports 120 designated DO andDl ■ 
, ,2 designated DO' and Dl % and the corresponding network nrput ports 120 ' '-V"*" 

Contented «*~~~rT£^~*~*~ 

♦ ♦ ^11? of the highspeed network port switching device 30. 
18 (FIG 1) is used for transferring data ring messages transferred from one dcv.ee to the next vta 

rEllringmessage.aaeeeiveM.Bevcnt^sage.aTran.mttMIBeventmcssagc.a 
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i n. event for the described embodiment he present invention are 
Command event, and a Re, . evenx ior m 

*, processing circuit 66 checks the header of .he message and processes the data nng message 

Lei ed message is a command event for another device, the message wtU he propagated 
niamwLtmodiftcation. ,fme received message is a command event for, he recetvtng 

vice, me da. ring processing circuit 66 of the receiving device executes the command £ 
^s .message. ^^^J^^^Z^T 

device win c P y modification and 

downstream by the data ring processing circuit 66 via the aaia n g 
terminated at the device that issued the message. 

^ 3A shows a detailed schematic circuit diagram of components of one of the cut- 
toough packet transfer switching devices 12 of the packet switching fabric .0 (FIG. 1). TTte 
tiering processing circuit 60 of the switching device ,2 inciudes: a contro, ring recetvmg urn, 

propagation pori .66, and a termination port ,68; a contro, message ptocessmg urn ^ an 
Lit port ,72 for receiving contro. messages from port ,66 of the recervmg urn, 62, a message 
otufpori !«, and four additional ports ,76, ,73, ,80, and ,82 mrther chained helow; and a 

output port ,74 of the contro, ring message processing unit ,70, a message output pori 90 for 
pmling contro, messages to the contro, ring output port 26 of the switching dev.ce , 2, a pori 92 

further explained he.ow, and a pair of ports 194 and 196 for receiving packet locarion 
lounceL, information & om me source management unit 90 as further exp anted below. 

The data ring processing circuit 66 of the switching device includes: a data nng recetvmg 
^t 202 having an input port 204 for receiving data messages and packet dala 
0 corresponding upstream one of the devices 12, 30, and 42 (FIG. 1) v,a cortespondtng one of the 

port 206 and a data termination pori 207 for providing burs* of packet da. reeved v,a the data 
ring to the destination managing unit 74 as further explained be.ow, a da. ring term.nat.on 
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passing unit 208 having ta«a inpu, port 210 for receiving data , data ring messages from 
ou,pu, port 206 of tire data ring receiving uni, 202, a data propagation port 212, and a port 
communicative* conpled with port 176 of .he contio. ring message processing urn, .70; and a dala 
ring transmitting unit 216 having a data inpu, port 218 connected to output port 212 <*****"»* 
.emtination processing uni. 208, an output port 220 com.ec.ed to .he dala ring oufpu, port 20 of tire 
switching device 12, a port 222 communicatively coupled with tire destination managing urn, 74, a 

* i . j... ft™ ihp racket buffer 100 via the source managing urut 
port 224 for receiving bursts of packet data from the packe, ourrer 

90 as further explained below, and a port 225 further explained below. 

The destination managing unit 74 of tire switching device 12 includes: a data drstnbution 
contio, uni. 240 having a muhicas, queue 242, an output buffer management urn, 244, eight output 
porta 246 each providing data to an input of a corresponding one of tire eight transmit buffer queues 
80 of .he switching device, an input port 248 for receiving bursts of packet data and data nng 
messages from output por. 207 of tire data ring receiving uni, 202, an input port 250 for reccvmg 
control messages from port 168 of tire control ring receiving nni, .62, a port 252 for recetvmg 
bursts of data from tine packe, buffer 100 via tire source managing nni, 90 as tether explamed 
below a port 254 communicatively coupled with port 178 of the control ring message processmg 
uni, 170 and a port 256 tether explained below; and an output queuing contio. unit 270 havmg a 
packe, location information uni, 272 for storing packe, location infonnation indicating the locations 
of packet da«a stored in tine packet buffers 100 of corresponding source ones of the dev,ces 12 and 
30 (FIG 1) as tether exp.ained below, an ouq>u, arbitration uni. 274 for arbitrating between a 
plurality of requests on behalf of data packets for access ,0 corresponding ones of the transmit 
buffer queues 86 as Anther explained below, a por, 276 communicatively conpled with port 180 of 
the control ring message processing uni, 170, a por, 278 communicative* conpled with por, 222 of 
the dan, ring transmitting uni. 216, a por, 280 communicatively coupled with port 256 of tine data 
distribution connol uni, 240, a por, 284 communicative* coup.ed witir tine source managmg unrt 90 
as tether explained be!ow, a port 285 communicatively coupled wi.h tine source managing urn, 90, 
a port 286 communicatively coupled with port 192 of the control ring transmitting urn, 186, aod a 
port 288 communicatively coupled witir the source managing uni. 90 as further explained below. 
' The source managing nni. 90 of tine switching device 12 includes: a packe. routing and 
, control uni. 302 having a packet routing .able 304 further explained below, a port 306 

communicative* coupled wi«h an onfpu, of each of the receive buffer queues 86 via a bus 308, and 
a port 310 communicatively coupled with port f94 of tine control ring transmitting urn. 186, and 
also communicative* coupled witin port 285 of tine output queuing control unit 270; a source 
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channel con.ro. uni, 318 fc ,g a port 320 conmrunicatively couple i* port in of ft. contiol 
ring message processing uni, 170, a por, 322 communicatively coupled wi* por, 284 of me output 
queuing conn-o, uni, 270, a por, 324 former exp.ained below, and a por, 325 communicatively 
coupled with port 225 of me da,a ring fransmitting uni, 216; an internal first-in first-ou, buffer 
(internal FIFO) 330 having an input port 332 for receiving bursts of packet da,a from a da,a ou,pu, 
port of the packe, buffer 100 via a pa,h 333, and an oubpu, port 334 for providing bursts of packet 
date ,0 port 252 of me data distribution control uni, 240 and ,0 port 224 of me da,a ring fransmrtting 
uni, 216 via a node 335 ,ha, is communicative., coupled wi* port 305 of *e packe, routing contio. 
urn, 302; and a packe, buffer confrol uni, 340 having a port 342 for receiving a channe. da,a tiansfer 
signal from port 324 of *e source channel contio. uni, 318, a port 344 communicatively coupled 
wi* port 288 of *e outpu, queuing confrol uni, 270 and also being communicatively coupled wrth 
port 196 of *e control ring tiansmitting uni, 186, and a port 348 communicatively coupled wrth a 
memory contiol port 350 of *e packe, buffer 100. As mentioned above, in ,he desenbed 
embodiment tire packe, buffer 100 includes two memory unite 102 and ,04 (FIG. 2A), and ,he pa* 
333 includes the first and second memory uni, links 103 and 105 (FIO. 2A). 

An ETHERNET frame, or packe, of date, includes header information specifying a source 
address of a source end node, and a destination address of a destination end node. ETHERNET 
frames lypically have a leng* between 64 by.es and 1 536 bytes. When a date packet is recerved vte 
one of *e network inpu. ports 88, *e date packe, is initially buffered by ,he corresponding one of 
,he receive buffer queues 86 and is passed ,o ,he bus 308. The packe. routing and confrol urn. 302, 
which is connected to *e bus via its inpu, 306, receives .he header information of *e packe, 
including the ETHERNET destination address of .he packet. Concurrcn.ly, *e packet .s 
transmitted ,o and stered in the external packe, buffer 100 by *e packe, buffer contiol unrt 340. 
The packe, buffer confrol uni, 340 includes a memory uni. (not shown) for storing pointer address 
location information associated with each of the received date packete. 

The packe, routing and contiol uni, 302 reads *e destination address included in the header 
information of each date packe, received via *e network ports «o determine a destination ID value 
indicating a des.ina.ion one of *e network ports of a destination one of *e switehing devrces 
associated wi* *e received date packe, via *e packe, routing teble 304 which provides ID codes 
of *e destination device and destination port which is communicatively coupled to *e destination 
end node specified by me destination address. The packe, routing teble 304 indicates a *e 
destination network output port of *e destination one of .he devices 12 and 30 (FIG. 1) to which a 
particular packe. must be forwarded to reach ,he end node indicated by the destination address 



specified by the packets he ;r. The packet routing and control uni )2 reads the header 
information of the data packet including the source address and destination address, and performs a 
packet destination look up operation using the destination address. In an embodiment of the present 
invention, the packet routing and control unit 302 performs an automatic address learning function 
to create and continually update the packet routing table 304 using the source address of each data 
packet received by the unit 302. In alternative embodiments, the packet routing table 304 is created 
via manual entry, or via a combination of the manual entry and automatic address learning schemes. 

The destination address specified by the header information of a data packet may be a 
multicast address which specifies multiple destination nodes, or a broadcast address which is 
specifies all destination nodes in the network. For multicast addresses, the packet routing table 304 
may yield multiple destination port ID values for one or more destination devices. If the destination 
address of a data packet includes more than one of the network ports of a device receiving the 
message, the message will be terminated from the data ring and copied to the multicast queue 242. 
From the multicast queue 242, the data packet is distributed to selected ones of the transmit buffer 
queues 80 connected to the corresponding destination network ports for transmission. 

If no match is found for a specified destination address in the packet routing table 304, the 
destination address is unknown. In this case, the packet may be broadcast to all ports (except the 
receiving port of the receiving device), or may be transferred only to an up-link port specified at the 
receiving port. When a match is found in the packet routing table 304 for a destination address 
specified by packet header information, it is then determined whether the destination address is 
connected to a network port of the receiving device, or to a network port of another device of the 
switching fabric 10 (FIG. 1) in order to determine whether a local or remote packet transfer 
operation is required. 

The packet routing control unit 302 is further operative to append each of the data bursts, 
provided by the packet buffer 100 via the FIFO 330, with block header information including the 
destination ID value, and an end of packet indicator for indicating whether the data burst is a last 

data burst of the data packet. 

The source managing unit 90 is also operative to control the transmission of bursts of data 
from a selected one of the memory units 102 and 104 (FIG. 2A) of the source device to the data ring 
processing circuit 66 via the corresponding one of the selected memory unit links 103 and 105 (FIG. 
2A). 

The packet buffer control unit 340 is operative to access data packets stored in the packet 
buffer unit 100, and is also operative to store pointer information indicating memory locations in the 
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packet buffer unit ,00 for t ing ft. received data packets. Tfte pa t buffer control urn, 
operative to generate a control signal a, i,s port 348 for reading data bursts ftom Ac packet buffer 
, 00 in response ,o the channel data transfer signal received a, Us port 342 ftom fine source channe, 
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control unit 318. . . 

The source channel control uni, 3 1 8 is responsive ,o the received nouf.cauon mformafion, 

and operative ,o general an initial channe. dam ttansfer signa, associated with each one of the 

received notification messages. The channe, data transfer signal is repeatedly activated a spectfied 

number of times in accordance with an associated initial channel rate value, the specified number 

being determined based on the associated initial channel credit value. The packet buffer control 

uni, 340 is responsive to the channel dab, transfer signals, and operative to read the specfied 

number of dab, bursts of an associated se,ec,ed date packet, indicated by the packet location pointer 

information, from me packet buffer uni. 100 in accordance with an associated channe, rate value. 

The specified number of bursts are indicated by an initial credit value received from the destination 

managing uni. 74 of a corresponding destination one of the devices 12 and 30 (FIGS. 2A and 3A) 

The date distribution control uni, 240 is operative to read the header information of the date 

hursts teoeived ftom tire packet buffer of the associated source device, and disteibute tire date bursts 

,„ appropriate ones of the netivork ou«pu. por* 84. The multicast queue 242 of the date dtsmbuuon 

control uni. 240 is operative to distribute multicast date burs*, having header infornrahon 

specifying multicas, addresses, to corresponding muhtple ones of tire transmit queue buffers for 



20 transmission to multiple destination nodes. 

The omput buffer manager 244 of the date distribution control unit 240 is operative to 
monitor .he availability of buffer space in corresponding ones of the transmit buffer queues 80. 

The output buffer manager 244 is also operative to determine a number of blocks of buffer 
space avaUable a, each of the transmit buffer queues, each of the available blocks providing buffer 
space for receiving a burst of packet date from the destination managing untt 74. The packet 
transfer notification information further includes an initial credit value indicative of a number of 
available blocks a. .he transmit buffer queue coupled with tire destination network port associated 

with the selected data packet. 

A complete description of tire (unctions provided by each of the illustrated components of 
the cut-through packet transfer switching devices ,2 is provided below with respec, .o a ser.es of 
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30 

flow diagrams. 



flow diagrams. 

FIG 3B shows a detailed schematic eircui, block diagram of components of the hrgh speed 
netivork port switching device 30 of tire paeket switehing fabric 10 (FIG. 1). The high speed 



network port switching 30 is similar to the eut-through pack, ansfer switching devices 12 

(FIG 3A) and includes all of the same components except that in order to accommodate the 1 Gbps 
network ports 32 (FIG. 1) for transmitting and receiving data packets via corresponding 1 Gbps 
ETHERNET links 33, the larger transmit buffer queues 1 10 capable of storing a whole data packet 
5 are used, and cut-through packet transfer is not performed. In an embodiment of the present 
invention, the switching device 30 is implemented by an application specific integrated circuit 
(ASIC). The functions of each of the components of the device 30 are very similar as further 
described below. 

As mentioned above, in accordance with inter-device packet transfer operations, the control 
10 ring message processing unit 170 is operative to provide packet transfer notification information to 
the source channel control unit 318 in response to receiving a PTN message via the control nng 
receiving unit 186 from a corresponding remote source one of the devices 12 and 30 (FIG. 1). The 
packet transfer notification information includes: a destination ID value indicative of a 
corresponding destination switching device and destination port associated with a corresponding 
1 5 data packet to be transmitted via a corresponding channel; address location pointer values indicative 
of a memory address of a corresponding selected data packet stored in the local packet buffer 1 00 
(FIG. 2A), the selected data packet having been selected by the output queuing control unit 270 of 
the corresponding destination device for access to the corresponding destination port; a 
corresponding initial credit value indicative of a corresponding initial number of authorized data 
20 bursts of the selected data packet to be read from the local packet buffer 100 and transmitted to the 
corresponding destination device; and a corresponding initial rate value indicative of a 
corresponding initial rate for transmitting the authorized bursts of the selected data packet. 

In the described embodiment, the total bandwidth available in transmitting data and data 
ring messages via the data ring segments of the data ring 19 (FIG. 1) is 3.2 Gbps. Therefore, the 
25 data ring may support up to thirty two 100 Mbps channels. Data is transmitted from output port 220 
the data ring transmitting unit 216 in bursts of 64 bytes (or 512 bits) per second. For a data channel 
operating at 100 Mbps, one bit is transmitted in 10 nanoseconds, and one burst is transmitted m 
5120 nanoseconds. In this embodiment, the period of the channel rate timer may be 5120 
nanoseconds. 

30 For the high speed network port switching device 30, the maximum source-destination data 

ring channel bandwidth is not reserved all at once because the burden on the total bandwidth 
resources of the data ring would cause a degradation in the overall performance of the switching 
fabric Therefore, for packet transfer operations wherein the destination port is one of the 1 Gbps 
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network ports 1 12 (FIG. 21 an initial source-destination channel i. t up and its bandwidth is 
thereafter increased in incremental steps in accordance with the output queuing controlled protocol 
as further explained below. In the described embodiment, the bandwidth resolution of the source- 
destination channels for high speed destination port packet transfer operations is 100 Mbps and m 
order to establish a channel having the maximum channel bandwidth, the switching fabric sets up an 
initial channel having a 100 Mbps bandwidth, and then increments the bandwidth from 100 Mbps to 
the maximum channel bandwidth in incremental steps as further explained below. 

As mentioned above, in accordance with each inter-device packet transfer operation, a 
packet transfer notification message (PTN message) is transferred form a destination device to a 
corresponding source device, the PTN message including packet transfer notification information 
including a corresponding destination ID value, a corresponding address location pointer value, a 
corresponding initial credit count value, and a corresponding initial rate value. The PTN message is 
received at the control ring message processing unit 170 (FIG. 2A) of the corresponding source 
switching device, and the corresponding packet transfer notification information is provided to the 
source channel control unit 318. The packet transfer notification information is used to set up a 
channel for transferring a data packet from the source switching device to the corresponding 
destination switching device via a source channel path including corresponding ones of the data nng 
segments 18 (FIG. 1) disposed between the source and destination devices, and a corresponding one 
of the memory unit links 103, 105 (FIG. 2A). 

For local packet transfer operations, packet transfer notification information, provided to the 
source channel control unit 318 (FIG. 2A) by the local output queuing control unit 270, is used to 
set up a channel for transferring a data packet from the local packet buffer 100 (FIG. 1) to the 
corresponding local destination network port via a source channel path including the one of the 

memory unit links 103, 105 (FIG. 2A). 

A complete description of the functions provided by each of the illustrated components of 
the switching devices 30 is provided below with respect to a series of flow diagrams. 

FIG 3C shows a schematic circuit block diagram depicting further details of the source 
channel control unit 3 1 8 (FIGS. 3 A and 3B) at 360. In the depicted embodiment, the source 
channel control unit 318 includes a channel allocation circuit 361 for allocating packet transfer 
notification information to a corresponding one of a plurality of channel memory units in order to 
manage channel information associated with associated ones of the source-destination channel 
paths The channel allocation circuit 361 includes: a first input 362 for receiving local packet 
transfer notification information, associated with a selected local packet, from the local output 
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nueuing con.ro, uni, 270 0 ■ 3A) via port 322 of the source chant, control urn,; a 
363 for receiving remote pacta, transfer notification information, associated warn a selected transfer 
packet, from the con.ro> ring message processing urn. 170 (FIG. 3A) via port 320 of the source 
channel contml unit; and a plurality of otepute 364 each for providing selected local and remote 
packet transfer notification information to a corresponding one of a plurality of N channel control 
circuits 365 via a corresponding has. The channel allocation circui. 36! includes logtc for 
determining an availah.e one of the chamte. control circui. 365, artd multiplexing ogtc or routing 
packe, tiansfer notification information to tire corresponding selected ones of me channe, contio. 
circuits 365. 

Each of me channel control circuits 365 includes: a plurality of N channel parameter 
memory uni. 366 designated CHANNEL.. , CHANNEL_2,..-CHANNEL_N, each heing operative 
,„ store and manage a corresponding set of channel parameters associated with a correspond 
source-destination channel dynamically allocated on corresponding ones of me date nng ^segments 
,« (FIG 1) and corresponding ones of the memory uni. links 103 and 105 (FIGS. 2A and 2B); and a 
phlfity of N channel rate timers 368 designated TIMER.., T.MER.2....T.MER N each heing 
communicative., coupled with a corresponding one of the memory unite 366 via a correspond,^ 
connection 369 as further explained below. 

Each of the channel parameter memory unite 366 provides for storing and managmg a 
corresponding se, of channel parameters associated with a corresponding one of the source- 
destination channels «ha, is initialized by tite source managing uni. 90 (FIG. 3A) in response to 
packe. transfer notification infonnation associated with a selected one me date packets, me 

por, 322 if*, corresponding packe, tiansfer operation is local, or from me contio. nng message 
processing uni, 170 (FIG. 3A) via por, 320 if tee corresponding packe, tiansfer operation ,s an mter- 
device tiansfer operation. As mentioned above, <he packe, tiansfer notification information 
includes a corresponding destination ID value, corresponding address location pointer values, a 
corresponding initial credi, count value, and a corresponding initial channel rate value. 

In tire depicted embodiment, each of the channel parameter memory unite 366 mcludes: an 
associated one of a plurality of N destination ID registers 370 designated DSTREGJ , 
) DST REG 1 DST REG N, each having an input for receiving a corresponding destination 
identification value; and an associated one of a plurality of channel credit counter unus 372 
designated CREDIT CTR 1 , CREDIT_CTR_2,...CREDIT.CTR_N, each having a firs, mpu, for 
receiving corresponding initial and incremental credit coun, values indicative of correspondmg 



initial and incremental nun rs of credits, or data bursts to be read n the local packet buffer 100 
(FIG 2A) Each of the channel credit counter units 372 also includes a count input 373 for 
receiving a count down signal from port 342 of the packet buffer control unit 340 (FIG. 3A) via the 
channel allocation circuit 361 and via port 324 of the source channel control unit. The count down 
5 signal is asserted each time a corresponding data burst is read from the local packet buffer 100 
(FIG 3A) of the source device. Each of the channel credit counter units 372 is operative to 
decrease the corresponding stored channel credit count value in response to the count down signal 
each time a corresponding data burst is read from the packet buffer 100 (FIG. 3 A). 

Each of the channel parameter memory units 366 further includes an associated one of a 
10 plurality of N pointer registers 374 designated POINTER_REG_l , POINTER_REG_2, 

POINTER_REG_N. Each of the pointer registers 374 includes: an input for receiving a 
corresponding address location pointer value, indicative of corresponding memory address of a 
corresponding selected data packet stored in the local packet buffer 1 00 (FIG. 3 A), via the channel 
allocation circuit; and an output for providing the stored pointer value via port 324 of the source 
15 channelcontrolunittoinput342ofthepacketbuffercontrolunit340(FIG.2A). The address 

location pointer value may be provided from the local output queuing control unit 270 (FIG. 3 A) via 
port 322 if the corresponding packet transfer operation is local, or from the control ring message 
processing unit 170 (FIG. 3A) via port 320 if the packet transfer operation is an inter-device transfer 
operation. 

20 Each of the channel parameter memory units 366 further includes a corresponding one of a 

plurality of N channel rate counter registers 375 designated RATE_CNTR_1, RATE_CNTR_2,... 
RATE CNTR_N each having an input for receiving corresponding initial and incremental channel 
rate values indicative of corresponding initial and incremental channel rates. The incremental 
channel rate value, received via a corresponding PTN message as further explained below, is 

25 indicative of a period for transmitting bursts of packet data from the packet buffer 100 (FIG. 3A) 
via the FIFO 3 1 8. The initial and incremental channel rate values may be provided from the local 
output queuing control unit 270 (FIG. 3 A) via port 322 if the corresponding packet transfer 
operation is local, or from the control ring message processing unit 1 70 (FIG. 3 A) via port 320 if 
the packet transfer operation is an inter-device transfer operation. Each of the channel rate counter 
30 registers 375 is operative to decrease the corresponding stored channel rate value in response to an 
incremental channel rate signal because the channel rate value is indicative of the period between 
bursts which is inversely proportional to the channel rate. 
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Each of .he channe «e timers 368 includes an input for ree ing a correspond one of 
fte channe, rate values from tine output of a corresponding one of the channe, rate reg,,ers 375 vra 
Ore corresponding path 373. Each of the channel rate timers 368 is operate to generate ft. 

ZZ unit to por, 342 of the packet buffer control unit 340 (FIG. 3A). ,n response ro the channe, 
rate control signal, the packet buffer control unit 340 (FIG. 3A) reads correspond bursts of 

FIG 4A shows a block diagram depicting a neia sirunw 
announcement message (unices. PLA message) used in the output q ueuing comroUed packet 
nansfer protocol of the present invention. The unices. PLA message 400 mc.udes 36 b,«s and ,s 
hansmmed from a source one of the switching devices ,2 and 30 (FIG. ,, to a ~dmg 
destination one of tire switching devices via the control ring 25 of tire swr.ch.ng fa bn 10 (P.O. 1). 

; received a. a corresponding source device, for access tir a corresponding destination ourpu, por, of 

ID field 404 for carrying five higher order bus of a seven-bi. destination device ID value for 

indicating a corresponding destination device and destination por. associa,ed wift a „n mg 
0 packe. transfer operation; a second nine-bi. string 406 having a second destination ID fie, OS for 

carrying two ,ower order bits of tire destination device ID value, a source dev.ee ID field for 

a corresponding ftree-bi. source device ID va,ue indicating tire source dev.ce assoe^ed 
eorresponding packet tiansfer operation, and a unicas, PLA message .dentificauon fi Id 

412 for carrying a tivo-bi. message ID value of «00» for identifying tire message as a umcast PLA 

higher order bits of a packe. location address information value for speeifying the location of tire 
corresponding da. packe, in the packe, buffer ,00 (FIG. 3A) of.be corresponding source dev.ce; 
and a Lft nine-bi, siring 418 having a second paeke, location poinler field 420 for carryrng five 
,ower order hi* of the ten-bi, packe, location address information value, and a serv.ee class field 
30 422 for carrying a two-bi, service class value tira. is indicative of service Cass information earned 

by the corresponding packet. 

FIG 4B shows a block diagmm depicting tire field structure of an unknown/multicas, packe, 
toeation am—en, message (unknown/multieas. PLA message) used in the ou,pu, q ueuing 



control protocol of the pre, : invention. The message 430 include, i bits and is transferred from 
a source one of the switching devices to a corresponding destination one of the devices v» 
corresponding ones of the nine-bit control ring segments 24 (FIG. 1) during four cycles of the 
control ring 25 (FIG. 1). The unknown/multicast PLA message 400 provides a request to a plurality 
of destination devices, on behalf of a data packet received at a corresponding source dev.ce and 
having a multicast destination address or an unknown destination address, for access to a 
corresponding plurality of destination network ports of the destination device. 

The message 430 includes: a first nine-bit string 432 having a one-bit unknown/multicast 
field 434 for storing a value indicative of whether the destination(s) associated with the 
corresponding packet is specified as a multicast destination address or an unknown address, and a 
destination bit map having four destination device ID fields 436, 438, 440, and 442 each carrying a 
corresponding single bit indicative of whether a corresponding one of the N=4 switching dev.es 12 
and 30 (FIG 1) is designated as one of the destination devices of the multicast data packet; a second 
nine-bit string 446 having a source device identification field 448 for carrying a three-bit source 
device ID value indicative of the source device at which the corresponding packet has been 
received a gateway destination field 450 for carrying a one-bit value indicative of whether the 
corresponding multicast destination addresses include another one of the packet switching fabncs 
10 (FIG 1) connected to the fabric 10 (FIG. 1) via a gateway (not shown) winch may be 
communicatively coupled to the data ring and the control ring 25 (FIG. 1) of the packet switching 
fabric a local high function device destination field 452 for carrying a single bit indicative of 
whether the corresponding multicast destination addresses include a corresponding high function 
device (e g., the CPU 51 of FIG. 1), and a message type ID field 454 carrying an unknown/umcast 
PLA message ID value which is equal to "00"; a third nine-bit string 458 having a first packet 
location pointer field 460 for carrying five higher order bits of an associated ten-bit packet location 
pointer address value indicative of the location of a corresponding data packet in a packet buffer 
100 (FIG 3A) of the corresponding source device; and a fourth nine-bit string 464 having a second 
packet location pointer field 466 for carrying five lower order bits of the packet location address 
pointer information value, and a service class field 468 for carrying a service class value associated 

with the corresponding packet. 

FIG 4C shows a block diagram depicting the field structure of a packet transfer notified 
message (PTN message) used in the output queuing protocol of the present invention. The PTN 
message 470 includes 36 bits and is transmitted from a destination one of the switching devices 12 
and 30 (FIG 1) to a corresponding source one of the switching devices via corresponding ones of 
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. , ,.„„ .„. s 24 (FIG 1) of the control ring da j four cycles of the control 
the nine-bit control ring se^ .nts 24 tftu. i) o „„„„ 

ring. The PTN message 470 is developed by the destination dev.ce ,n response to a PLA message 
previously sen, by Ore corresponding source device to the destination device, and is —ted by 
L destination device after a se, of packet transfer operation criteria has been deterouned to be 
satisfied by ftte destination device. The packet transfer operation criteria includes: selection of tire 
corresponding data packet, as indicated by fire corresponding previous PLA message by fi,e output 
arbitration unit 274 (FIG. 3A) of the destination device; a delation by fire outpu buffer 
Hging unit 244 (FIG. 3 A) of fire destination device that there is sufficient available ^ buffer 
space at a corresponding one of the transmit buffer queues 80 (FIG. 3A) or 1 10 ^ ^ ^ ^ 
domination by fire control ring message processing unit .70 of fire destinatron dev.ee that a 
Sclent amount of bandwidth resources is available on the data ring .9 (FIG. 1) of fire packet 

SWiK Tp™ message 470 Includes: a firs, nine-bi, srring 472 having a firs, desfinafion U> field 
474 for carrying five higher order bits of a destination device ID value indicating a corresponding 
destination device and destination port associate with fire corresponding packet transfer operation; 
a second nine-bi, string 476 having a second destination ID field 47S for carrying nvo lower oMer 
bits of the destination device ID value, a souroe device ID field 4S0 for canymg a ■ «~* «™ 
d evlce ID value indicative of an associated source one of the switching dev,ces 1 and 3 » 
associated with tine corresponding packet transfer operation, and a PTN message We field 4 2 or 
carrying a two-bi. PTN message ID value e q ua, ,o «01»; a fitird nine-bi, suing 486 havmg a firs, 
packet location pointer field 488 for carrying five higher order hi,, of a ten-bi, packet locaoon 
pointer value indicative of a location of a corresponding data packe, in a packet buffer . 00 (F.G. 
3A) of the corresponding source device; and a four* nine-bit string 490 having a second packet 
,oca«on pointer field 492 for carrying five lower oroer bits of tire packer location address pourter 
S information value, an initial credit value field 494 for carrying a one-bit initia, chase ered.t value, 
and an initial channel rate field 496 for carrying a one-bit initial rate value. 

The initial credit field 494 may carry a value of zero or one. In an embodrment, an mrfial 
credi, value of one indica.es tha, a corresponding one of tire transmit buffers 80 (FIG. 3A) an 10 
(FIG 3B) includes a, leas, one block of available spaoe which is sufficient to accommodate a, leas, 
0 one dala burst. A single credi, is associated with available space for one burs, of a packet data As 
mentioned above, the output buffer manager 244 (FIG. 3A) of tine da. distribution ^ ™* ™ 

•, K-rtv Wfer soace for each of the transmit buffers 80 (FIG. 3A) and 
(TIG 3 A) monitors the availability of butter space iore^n 

• • • , v i o „f wm indicates that there are at least two blocks of available 
110 (FIG 3B) An initial credit value of zero indicates xnai uw 



space sufficient for acconu lafing two bursts of packer data at the responding one of the 
Ism., buffers. Because, in the depicted embodiment, me PTN message 470 Inc.udes a ,ng!e bti 
,„ indicate the initia. credit va.ue, a maximum of two credits may be mitiaHy provrded to me 
corresponding source device via me PTN message. As farther exp.ained be.ow, an mcrementa, 
credit transfer (ICT, message is sen, subsequent* in order ,0 lucres me credd vaiue to a 
corresponding maximum credit vaiue, that is the actua, number of bursts whtch may be provtded to 
.he corresponding one of the transmit buffers in the destination device a, the current time. As an 
example the output buffer manager unit 244 (FIG. 3A) may determine rha, a seiected one of the 
transmit buffer queues 80 (FIG. 3A) currently includes 3 Mocks of availab.e space. Therefore, tite 
current maximum credit vahre associated wim fire se.ec.ed transmit buffer queue ts equ* o ^ 
te case, Ore initial credit field 494 of a PTN message, associated with a packet desnned for tire 

Mocks a, the selected transmit buffer queue, and an ICT message sent ,mmed,a.e.y after tire PTN 
message cartes an incremental credit vaine of one to increase «ha« total crcdi. value to tire 
maximum value of 3. Note that there is no latency between the ICT message because tire ICT 
message is sen, via tite control ring 25 (FIG. 1) from the destination device to tire source device 
while I first one or two bursts are transferred ftom tire source device to tite destination dev.ee v,a 
tire data ring. Therefore farther bursts may be transmitted ftom the source device to tite destination 
device in response to the ICT message, in a pipelined manner. 

PIG 4D shows a block diagram depicting the field structure of an incremental cred,, transfer 
message (ICT message) at 500, the ICT message 500 being used in the output queuing con.ro, 
protoco. of the present invention. The ICT message 500 includes 18 bits and is tiansm.tied ftom a 
destination one of the switching devices ,2 and 30 (FIG. 1) to a source one of me 
via the con«ro, ring 25 (FIG. 1) during two cyc.es of the control ring. The ICT message 500 
indicates to tite corresponding source device that a credit value, indicative of a number o bursts to 
be transferred ftom the source device to the destination device via tire data ring and uutiahzed by a 
corresponding previous PTN message 470 (FIG. 4C) is to be increased. 

The ICT message 500 includes: a first nine-bit string 502 having a destination ID field 504 
for carrying five higher order bits of a destination ID value; and a second nine-bi, string 506 havmg 
, an incremental credit fie.d 508 for carrying a corresponding three-bit incrementa. cred,, va.ue for 
ins.mc.ing the source device ,o increase tire associated channel credi, for tire associate packet 
<r m sfer operation by .he corresponding incremental credi. value, a second destination ID fie.d 510 
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fcrcarryingtwolowerord, , iMfte a eS «on,D*-an 

■ ,„ 1CT message ID value of "10" indicating that the message 500 ts an ICT message. 

" W ^ ICT v H . aarara illustratin6 a field structure of an incremental rate transfer 

FIG 4E shows a block diagram illustrating a new a 

essaae (IRT message) 520 used in the output queuing controlled packet transfer protocol of fire 

~ZTtL«I message 520 
fie. itching devices .2 and 30 (FIG. 1) to a corresponding source one of fire sw.tch.ng devices 
L lLpondLg ones of the nine-hi, control ring segments 24 (FIG. 1) during two cycles o * 

control ring of .he pac.ce, switching fabric. The IRT message 520 indicates ,0 the correspondmg 

ZZ del. .h* the corresponding channel rate value, initialized by a correspondmg prevous 

PTN message 470 (FIG. 4C), is to be increased. 

2 IRT message 520 indudes: a firs, nine-hit string 522 having a firs, des.inat.on ID field 

destination device; and a second nine-hi, string 526 having an incremental rate field 528 for 
e^ing a three-bi, incremental ra,e value for instructing fire source dev.ee to ™ fire 
Ziated channel ra,e for ,he associated packet transfer operation by fire correspondmg 
Lmenta. ra,e value, a second destination ID field 530 for carrying two lower order ris o me 
dTstination ID value, and an IRT message type field 532 for carrying an IRT message ID value of 
"11" indicating that the message 520 is an IRT message. , H , at540 
HG 5 A shows a block diagram depicting a source iden,if.oa,.on mapp.ng «ab.e a, 540 
providing for mapping source idenfifrcauon vah.es carried by fire con.ro! ring »~*» ™* 
message , and da,a burs* (transmitted via,he con.ro, ring 25 (FIG. 1) and da. nng ,9 (FIG. 1) to 
llspo ding source ones of me devices ,2, 30, and 42 (FIG. I, and correspondmg source ones of 
^network input ports 88 (FIG. 2 A) of the cut through packet transfer switching devices and the 
network input ports 120 (FIG. 2B) of the high speed network port swi.ch.ng devces. 

The sol identification mapping table 540 includes: a first source device mappnrg table 
portion 542 providing a mapping berween an eight-bit source identification valut • ^0—8 
ones of eight source ports of a firs, source one of fire switching dev.ces 12 and 30 (FIG. I), second 
source device mapping .able portion 544 providing a mapping between an eigh.-b.t source 
identification va!ue and corresponding ones of eight source porta of a second source swtohmg 
Le- a third source device mapping table portion 546 providing a mapping between an e,g ,b„ 
^' identified value and corresponding ones of eight source ports of a third „ ^mg 
device- a fourth source device mapping table portion 548 providing a mapp,ng between an etght-b.t 
source identification value and responding ones of eight source ports of afourth source 
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switching device; a local h. function device mapping table portio, J2 providing a mapping 
between an eight-bit source identification value and corresponding ones of eight source ports of a 
local high function device (e.g., the dedicated management device 42 of FIG. 1); a remote high 
function device mapping table portion 554 providing mapping between an eight-bit source 
identification value and corresponding ones of eight source ports of a remote high function dev.ce; a 
gateway device mapping table portion 556 providing mapping between an right-bit source 
identification value and corresponding ones of sixteen ports of a gateway device; a trunk mappmg 
table portion 558 providing mapping between an eight-bit source identification value and 
corresponding ones of four trunks of a corresponding source one of the devices 12, 30, and 42 
(FIG. 1); and a multicast mapping table portion 560 providing mapping between an eight bit 
multicast source ID value and 128 multicast groups. 

FIG 5B shows a block diagram depicting a destination identification mapping table at 570, 
providing for mapping the destination identification values carried by the control ring messages, 
data ring messages, and data bursts (transmitted via the data ring 19 and control ring 25 (FIG. 1)) to 
corresponding destination ones of the devices 12, 30, and 42 (FIG. 1) and corresponding dest.nat.on 
ones of the network output ports 84 (FIG. 2A) of the cut through packet transfer switching devices 
and the network output ports 1 12 (FIG. 2B) of the high speed network port switching devices. 

The destination identification mapping table 570 includes: a first destination mapping table 
portion 572 providing mapping between an eight-bit destination ID value and corresponding ones of 
eight destination ports of a first.destination one of the switching devices 12 and 30 (FIG. 1), 
wherein mapping is specifically provided for 10 Mbps destination ports and 100 Mbps destination 
ports- a second destination mapping table portion 574 providing mapping between an eight-bit 
destination ID value and corresponding ones of eight destination ports of a second destination one 
of the switching devices 12 and 30 (FIG. 1), wherein mapping is specifically provided for 10 Mbps 
destination ports and 100 Mbps destination ports; a third destination device mapping table portion 
576 providing mapping between an eight-bit destination identification value and corresponding ones 
of eight destination ports of a third destination one of the switching devices 12 and 30 (FIG. 1), 
wherein mapping is specifically provided for 10 Mbps destination ports and 100 Mbps destination 
ports- a fourth device mapping table portion 578 providing mapping between an eight-bit 
destination ID value and corresponding ones of eight destination ports of a fourth destination one of 
the switching devices 12 and 30 (FIG. 1), wherein mapping is specifically provided for 10 Mbps 
destination ports and 100 Mbps destination ports; a local high function device mapping table 
portion 580 providing a mapping between an eight-bit destination ID value and corresponding ones 



of eight destination ports o. local high function device (e.g., the <k ;ated management device 42 
of FIG. 1); a remote high function device mapping table portion 582 providing mapping between an 
eight-bit destination identification value and corresponding ones of eight destination ports of a 
remote high function device; a gateway device mapping table portion 584 providing mapping 
between an eight-bit destination identification value and corresponding ones of sixteen ports of a 
gateway device; and a trunk mapping table portion 584 providing mapping between an eight-bit 
destination identification value and corresponding one of four trunks of a corresponding destination 

ones of the devices 12, 30, and 42 (FIG. 1). 

FIG. 6 shows a block diagram depicting a field structure of a channel resource patrol 
message, or patrol message, at 600. In an embodiment, the patrol message 600 is transmitted via 
the 33-bit wide data ring 19 (FIG. 1) of the switching fabric 10 (FIG. 1). In an alternative 
embodiment of the present invention, the patrol message 600 is transmitted via the control ring of 
the switching fabric 10 (FIG. 1). As further explained below, the patrol message 600 includes data 
ring channel bandwidth information including a plurality of channel bandwidth parameters 
indicative of available bandwidth resources for transmitting data packets between corresponding 
source and destination ones of the devices 12, 30, and 42 via the data ring of the switching fabric 10 
(FIG. 1). In the depicted embodiment, the patrol message 600 includes three cycle strings, each 
cycle string having 33 bits each being transmitted during a corresponding cycle of the data ring 19 
(FIG. 1). 

The bandwidth parameters of the patrol message 600 are managed by the control ring 
message processing unit 170 (FIG. 3A) of the control ring processing circuit in accordance with a 
channel rate reservation process. The control ring message processing unit 170(FIG. 3A) is 
operative to read the patrol message 600, and is also operative to adjust the bandwidth values of the 
patrol message in response to information received from the destination managing unit 74 (FIG. 3 A) 
and the source managing unit 90 (FIG. 3A) of the destination and source devices 12, 30, and 42 

(FIG. 1) of the switching fabric. 

The patrol message 600 includes a first cycle string 602 for carrying bandwidth parameters 
indicative of bandwidth available in data paths associated with high function devices of the data 
ring of the packet switching fabric. The first cycle string 602 of the patrol message includes: a 
channel resource patrol field 604 for carrying a three-bit patrol message ID value equal to "000" 
indicating that the message 602 is the patrol message; a high function device link bandwidth field 
606 for carrying a five-bit value indicative of a current amount of bandwidth available at a 
corresponding data ring segment providing coupling between a high function device of the 
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switching fabric 10 (FIG. . nd an adjacent device of the switching xic (e.g., the data ring 
segment 1 8 providing coupling between the dedicated management device 42 and the switching 
device 12 designated SWITCH_0) of FIG. 1 ; a first high function memory unit link bandwrdth field 
606 for carrying a four-bit value indicative of a current amount of bandwidth available at a 
corresponding memory unit link providing coupling between a high function device of the 
switching fabric 10 (FIG. 1) and a corresponding memory unit (e.g., the memory unit link 55 
providing coupling between the dedicated management device 42 and the first high function 
memory unit 54 designated MEMORY_A of FIG. 1); and a second high function memory unit link 
bandwidth field 608 for carrying a four-bit value indicative of a current amount of bandwidth 
available at a corresponding memory unit link providing coupling between a high function device of 
the switching fabric and a corresponding memory unit (e.g., the data ring segment 57 providing 
coupling between the dedicated management device 42 and the second high function memory umt 
56 designated MEMORY_B of FIG. 1). 

The patrol message 600 also includes a second cycle string 620 for carrying data ring 
channel bandwidth parameters indicative of amounts of bandwidth available at corresponding ones 
of the data ring segments 1 8 (FIG. 1) associated with corresponding ones of the switching devices 
12 and 30 (FIG 1) of the packet switching fabric. The second cycle string 620 of the patrol 
message includes: a first device link bandwidth field 622 for carrying a five-bit data ring channel 
bandwidth value indicative of a current amount of bandwidth available at the data ring segment 18 
(FIG 1) providing coupling between SWITCH_3 and an adjacent device of the switching fabnc; a 
second device link bandwidth field 624 for carrying a five-bit data ring channel bandwrdth value 
indicative of a current amount of bandwidth available at the data ring segment 18 (FIG. 1) providing 
coupling between SWITCH 2 and an adjacent device of the switching fabric; a third device link 
bandwidth field 626 for carrying a five-bit data ring channel bandwidth value indicative of a current 
amount of bandwidth available at the data ring segment 18 (FIG. 1) providing coupling between 
SWITCH 1 and an adjacent device of the switching fabric; and a fourth device link bandwidth field 
628 for carrying a five-bit data ring channel bandwidth value indicative of a current amount of 
bandwidth available at the data ring segment 18 (FIG. 1) providing coupling between SWITCHJ) 
and an adjacent device of the switching fabric. 

As mentioned above, in the described embodiment, the total bandwidth available in 
transmitting data via each ofthe data ring segments 18 (FIG. 1) of the data ring is 3.2 Gbps. 

Therefore, each ofthe data ring segments may support up to thirty-two 100 Mbps channels, 
and each ofthe data ring channel bandwidth values includes five bits having a value between 0 and 

_1 1 _ 



32 As mentioned above, I ;onfro. ring message processing uni. ■ (FIG. 3 A) is operative to 
mad and adjust each of the dam ring channel bandwidth values carried by .he pa.ro, 
accordance with a channel rate reservation process. The control ring message processmg urn, ts 
opemtive ,o : increase se.ected ones of me data ring channel ba„dwid,h values by one upon 
alcating 100 Mbps of bandwidth for a corresponding channel; and decrease seated ones of 
da* ring channel bandwidm values by one upon releasing 100 Mbps of bandwidth from a 

corresponding channel. , _ 

The pan-el message 600 former includes a third cycle string 630 for canymg values 
indicative of amoun.s of bandwidm available at corresponding ones of me memory unit hues ,03 
Id .05 (FIG. 2A) of corresponding ones of me switching devices ,2 and 30 (FIG. I) of me pac « 
switching fabric. The third cycle string 630 of.be patrol message includes, a firs. ^memory ^ - 
bandwidm field 632 for carrying a four-bit value indicative of a current amount of bandwtdth 
available a, the memoty unit link 103 (FIG. 2A) providing coupling between Ore source managtng 
unit 90 (FIG. 2A) and the firs, memory unit 102 (FIG. 2A) of SW.TCH.3 of the swnchrng fabrtc 10 
(FIG . I); a second memory Una bandwidth field 634 for carrying a four-bit memory urn, Wwtdd, 
value ind.ea.ive of a current amount of bandwidth available a, the memoty urn. hnk ,05 (FIG. 2A) 
providing couphng between the source managing unit 90 (FIG. 2A) and me second memoty urn. 
104CFIG 2A)ofSWlTCH 3 of the switching fabric; a third memory unit link bandwtdth fielc 636 
for carrying a four-bit memory unit bandwidm value indicate of a current amoun. of bandwtdth 
available a. me memory uni, link ,03 (FIG. 2A) providing coupling between the source managmg 
unit and the fits, memory unit .02 (FIG. 2A) of SWITCH.2 of the switching fabnc; a fourth field 
638 for carrying a bandwidth value indicative of a cun-en, amoun, of bandwidth arable at the 
memory unit link 105 (FIG. 2A) of SWITCH_2; a fifth memory link bandwtdth field 640 for 
carrying a four-bit value indicative of acurren, amoun. of bandwidth avaUable a, the memory umt 
Hnk ,03 (FIG. 2A, of SWITCH,, ; a sixth field 642 for carrying a fom-bit^ue mdicaftve of a 
current amoun, of bandwidth available a, the memory unit link ,05 (FIG. 2A) 
seven* field 644 for casing a value indicative of a current amount of bandwtdth avatlable a. the 
memory unit link 103 (FIG. 2A) of SWITCH_0; and an eighth fie.d 646 for carrying a vafoe 
indicative of a cun-en, amoun, of bandwidm available a, the memory uni, hnk 105 (FIG. 2A) of 

' S WIT ™-°' ? shows a block d . agram depMng , fleld structure of a packet transfer initialization 
message (PTI message) a, 650, the PTI message 650 being transmitted via the data ring 19 (FIG. 1) 

• u- fi,' in rvia 1 ^ The PTI message 650 is used in multicast packet 
of the packet switching fabric 10 (FIG. 1). Ifte v n me^ag 



^sfer operations for in*, ing specified destination switching de as «o transmit an assorted 
data packet fiom specified ones of rhe network onrpu, ports of tire corresponding specrfied 
destination device. The PTI message 650 is transmitted via tire 33-bi. data nng ,9 (FIG. ) of me 
switching fabric, and ine.udes rwo cycle snings, each having 33 bits and being transmuted dunng a 
corresponding cycle of me data ring. The PTI message 650 includes a firs, cycle stirng ; 652 for 
carrying multicast instructions for multicasting an associated dam packet fiom specrfied destination 
ZZ ports of a specified destination one of the switching devices 12 and 30 (P.O. I). The firs, 
cyc.e stiing 652 includes: a PTI message ID field 654 for carrying a three hi, ™ -sage ° value 
of ■ -001" for identifying the message 650 as a PTI message; a first source devrce ID field 656 for 
carrying two higher order bits of a source device ID value indicating a corresponding source one of 
th e switching devices storing the associated data packet that is to be multicasted; a second source 
device ID field 658 for carrying a lowest order bi, of the source device ID value; a packet 
destination ID field 660 for casing a 7-bi, packet destination ID value for indicating destination 
network output ports for multicasting the associated data packet; and an operation type field 662 
The PTI message 650 also includes a second cycle sring 670 for carrying multicast instructions for 
multicasting an associated data packet via a gateway (no, shown) coupled witir tire packet switchmg 

fabric 10 (FIG. 1). . 

FIG 8 shows a flow diagram illustrating a source device managtng process a, 700, the 
process 700 being initiated by tire source managing unit 90 (FIG. 2A) of a corresponding source one 
of the switching devices 12 and 30 (FIG. 1). The process 700 begins with a step 702 in whrch a 
data packet is received a. a source one of the switching devices 12 and 30 (FIG. 1) v,a a 
corresponding source one of tire network inpu, ports 88 (FIG. 3A) and ,20 (F.G. 3B, From step 
702 the process proceeds to step 704 in which the packet buffer control unit 340 (FIG. 3A) 
abates memory spaca in the local packet buffer .00 (FIG. 3A) for storing the data packet recerved 
in step 702. From step 704, tire process proceeds to step 706 in which packet .ocation pomter 
information indicative of the memory space in tire packet buffer 100 for storing tire received data 
paeke,, is stored in a memory (nor shown) of tire packetbuffer control unit 340 (FIG. 3A> In step 
708 tire received data packer is stored in the allocated memory space of the local packet buffer of 
tire source device. From step 708, tire process proceeds ,0 step 710 in which the packet routtng 
, conrrol unit 302 (FIG. 3A) reads packet header information of the received data packet ,n order to 
determine a destination node associated with the received dans packet. Also in step 710, the packet 
routing control unit 302 (FIG. 3 A) reads the packet routing table 304 (FIG. 3 A) to determine a 
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destination one of tite net» . outpn. pom 84 (FIG. 3A) ana ,12 (I . 3B) of a destination one of 

the switching devices 12 and 30 (FIG. 1). ^ 

From step 7,0, the process proceeds to 7.2 a. which i, is detennined whedrer Ote dest.nat.on 
device (detennined in step 7,0 by the packet renting and contro. unit) is .oca., Una, is whether tire 
destination device is the same switching device a, which the packet has been renewed. If,, - 
determined a, 712 Una, me desrina,io„ pot, is loci, me process proceeds ,0 step 714 m w eh the 
packe, touting conh-o. uni, 302 (FIG. 3A) issnes a request ,o me output arbitral un., 274 (FIG. 
3A) of me ontpu, queuing contro, uni, 270 (FIG. 3 A) for access ,0 the destination network port 
associated whh me received da. packet, as determined in step 7.0, after which the process returns. 

Alternatively, if i, is determined a, 7.2 tha, the destination port is no, a local network port, 
.he process proceeds ,o step 716 in which the contro, ring transmitting nmt .86 (FIG. 3A) ttansmt, s 
a PLA message 400 (FIG. 4A) ftom ,he source device .owards tire destination dev.ce vta tire contro, 
ring 23 (FIG. „ of the packet switching fabric. As described above, tine PLA message uteres : an 
associated destination device ID which is provided by the packet touting contro. urn. 302 (FIG. 3A) 
to the input .94 (F.G. 3A) of the contro. ring transmitting unit .86 (FIG. 3B); an assorted source 
device ID value also provided by the packet routing cento, unit; and associate, .ocafton 
pointer information which is provided by tite packet buffet con.ro. uni, 340 (FIG. 3A) ,0 port .96 
(FIG 3A) of the control ring transmitting unit 186 (FIG. 3A). 

' FIG 9A shows a flow diagram illustrating a destination device managing process a, 730a, 
ta process 730a being performed by the destination managing uni, 74 (FIG. 2A) and tite ccntiol 
ring processing citcui, 60 (FIG. 2A) of a destination one of tite switching devces 12 and 30 (FIG. 
,) in response ,o receiving a unices, PLA message 400 (FIG. 4A) from a source one of the 
switching devices via the cento, ring 24 (FIG. 1) of tite packet switching fabric. The process 0a 
begins with step 732a in which the PLA message is received a, the control ring tecetvmg urn, .62 
(FIG 3A) of me destination device. From step 732a, the process proceeds to 734a a, whtch « ,s 
determined the source device ID va.ue carried by the source ,D fie.d 4.0 (FIG. 4A) of the PLA 
message matches a device ID value associated with the destination device, and if so, the ptocess 
proceeds to step 736a in which the contro. ring message processing uni, ,70 (FIG. 3A) termtnates 
the message and reports an error, after which tite process ends. 
D Ahematively, if is determined a, 734a tha, the source device ID value earned by the packet 

,ocation announcement message does no. match the ,oca, device ID vahte, tite process proceeds to 
738a a. which i, is determined whether the destination device ID va,ue, carried by the delation 
device ,D fie.ds 404 and 408 (FIG. 4A) of tite PLA message, matches the ,oca, device ,D vahte, and 



if no, me process proceed step 740a in which the control ring n age processing unt. 170 
(FIG 3 A) passes the PLA message to the control ring via the control ring transmitting umt 186 
(FIG 3A) without modification. Alternatively, if it is determined a. 738 that the destination ID 
valne carried by PLA message matches the local device ID value, the process proceeds ,o step 742a 
in which the control ring message processing unit .70 (FIG. 3A) derives the source ID value earned 
by fire source ID field 410 (FIO. 4A) of the PLA message, and the packet location pomter 
information carried by fields 416 and 420 (FIG. 4A) of the PLA message. From step 742a, the 
process proceeds to step 744a in which the control ring message processing umt 170 (FIG. 3A) 
issues a request ,o the output arbitration unit 274 (FIG. 3 A) for access to a destination network 
output port connected to a corresponding destination one of the transmit buffer queues 80 (FIG. 3A) 
indicated by me destination ID value earned by the received PLA message. The output queuurg 
control uni, 270 (FIG. 3A) stores the packer location information, carried by fields 4.6 and 420 
(FIG 4A) of the PLA message, as well as the source device ID value carried by field 410 (FIG. 4A) 
and the destination ID value carried by fields 404 and 408 (FIG. 4A) in the packet locauon 

information unit 272 (FIG. 3A). 

FIO 9B shows a flow diagram illustrating a destination device managing process at 730b, 
,he process 730b being performed by the destination managing uni. 74 (FIG. 2A) and the control 
ring processing circuit 60 (FIG. 2A) of a destination one of the switching devices 12 and 30 (FIG. 
,) in response to receiving a multicast PLA message 430 (FIG. 4B) from a source one of the 
switching devices via the control ring 24 (FIG. 1) of the packet switching fabric. The process 730b 
begins with step 732b in which the multicast PLA message is received a, the control ring recervmg 
unit 162 (FIG 3A) of the destination device. From step 732b, the process proceeds to 734b at 
which it is determined me source device ID value carried by the source ID field 448 (FIG. 4B) of 
the multicast PLA message matches a device ID value associated with the destination device, and tf 
so the process proceeds to step 736b in which the control ring message processing umt 170 (FIG. 
3 A) terminates the message and reports an error, after which the process ends. 

Alternatively, if is determined at 734b that the source device ID value carried by the packet 
.ocation announcement message does no, match me loca. device ID value, the process proceeds ,o 
738b a, which i, is detenuined whether the destination bit map carried by the destination dev.ee ID 
fields 436 438, 440, and 442 (FIG. 4B) of the multicast PLA message, indicates the local dev,ce, 
and if no,, the process proceeds to step 740b in which the control ring message processmg umt 1 70 
(FIG 3A) passes the multicast PLA message to the control ring via the control ring transmitting urn, 
, 86 (FIG 3A) without modification. Alternatively, if i, is determined a, 738b ma. the destination 



bit map of the multicast P. message indiea,es the loea. device, «h. ocess proceeds «o step 741b 
in which me con.ro. ring message processing unit 170 (FIG. 3A) clears me correspond one of .he 
des.ina.ion device ID Adds 436, 438, 440, and 442 (FIG. 4B) of me destination bi. map earned by 
the multicast PLA message mat identifies the destination device. 

5 From step 741b, the process proceeds <o step 742b in which tire con.ro. ring message 

processing uni. derives tire source ID value carried by me source ID fie,d 448 ^ 
multicast PLA message, and the packet .ocation pointer information carried by fields 460 and 466 
(FIG 4B) of tire PLA message. From step 742b, the process proceeds .o step 744b in whrch the 
control ring message processing uni. 170 (FIG. 3A) issues a reques. to tire output arbitrauon urn, 

10 274 (FIG 3A) for access to a destination network outpu. port connected to a corresponding 

destination one of the transmit buffer queues 80 (FIG. 3 A) indicated by the destination ID value 
carried by the revived PLA message. The output queuing control unit 270 (FIG. 3A, stores tire 
packet .ocation information, carried by fie,ds 460 and 466 (FIG. 4B) of tire PLA message, as well as 
the source device ID value carried by field 448 (FIG. 4B) in the packet location infonna.ton unt. 

15 272 (FIG. 3 A). 

From step 744b, the process proceeds to 745b a. which the control ring message processing 
nni. determines whether all bits in tire destination device ID fields 436, 438, 440, and 442 (FIG. 4B) 
of the destination bit map have been cleared, and if so, the process proceeds to step 746b in whrch 
me control ring message processing unt, terminates tire message. Alternatively, if is determined a, 
20 745b .ha, no, aU of me bits of me destination bi, map have been cleared, me process proceeds ,o 
step 748b in which tire control ring message processing uni, propagates tire message. 

FIG 10A shows a flow diagram illustrating a destination device arbitration process a, 750, 
,he arbitration process 750 being performed by tire destination managing uni, 74 (FIG. 2A) and the 
con.ro. ring processing circuit 60 (FIG. 2A) of a destination one of tire switching devices 12 and 30 
25 (FIG 1) The process 750 begins with step 752 in which the output arbitration untt 274 (FIG. 3A) 
arbitrates between multiple local and remote competing requests for access to a correspond 
destination one of tire transmit buffer queues 80 (FIG. 3A) and 1 10 (FIG. 3B). As mentioned 
above, the competing requests are made on behalf of received data packets which may have been 
received a. a local network port of me destination switching device, or a remote network port of a 

30 remote one of die switching devices 12 and 30 (FIG. 1). 

As described above, local requests on behalf of dam packets stirred in me local packet buffer 

,00 (FIG 3A) of the local device are provided to the output arbitration uni, 274 (FIG. 3A) by tire 
source management uni, 90 (FIG. 3A). Also as mentioned above, remote requests for access ,o a 



d es t ina ti o„ per, on behalf packets received at re-no* ones of me ,.ch,ng devces arep^ed 
«„ .he output arbitration unit 274 (FIG. 3 A) by the control ring message processing unt, 70 (FIG. 
3 A) in response .o receiving a PLA message 400 (FIG. 4A) from the device mat recetved the 

PaCket From step 752, me process proceeds ,0 step 754 in which me arbitration unit 274 (FIG. 3A) 
.elects one of me dam packets, represented by a corresponding request, for access to an assocated 
s . . _ ..snirir, 3A1orllO(FIG.3B). The output queuing 

destination one oflhe transmit buffer queues 80 (FIG. 3A) or nut I 

control unit 270 (F.G. 3A) men accesses me corresponding packet location in formation, and 
destination ID value associated with ore selected dara pac.ee, from me packet location mformatron 

^ " f1 G s«p 754, the process proceeds to 756 a, which it is determined whether a last burst of 
a previous dam packet has been received by the associated one of the transmit buffer queues 80 
(FIG 3A) and 1 10 (FIG. 3B) in accordance with a previous packet transfer operation. The 
etermin tion a, 756 is made by me data distribution control unit 240 (FIG. 3A, ^ ,s opemttv e 
t0 umnitor the transmit buffer queues as described above. If it is determined a, 756 that die ... 
burs, of the previous data packet has no. been received, the process waits until is determined a. 
756thatthelastbmstofthepreviousdatapackethasbeenrece,ved. 

After it is determined a. 756 mat .he las. burs, of the previous data packet has been received 

a, the associated one of the transmit buffer queues, the pmcess proceeds to step 758 in which me 
output buffer meager 244 (FIG. 3A) of the destination switching device determines a number of 

b. ocks, or credits, of available space a, the associated destination of the transmit buffer queues 80 
(FIG. 3A) indicated by the selected packet. As mentioned above, the outpu, buffer manager 244 
(FIG. 3A) includes logic for counting Ore number of bursts of data transmitted to each of the 

transmit buffer queues. _ 

From step 758, the process proceeds ,0 760 a, which ,h. output buffer manager 244 (FIG. 
3A ) of the data distribution control unit determines whether a, leas, one block, or credit, of space ,s 
Ji,able a, the associated destination one of the transmit buffer queues indicated by the selected 
packet, and if no, the determination a. 760 is repeated until at leas, one block of space rs available 
at the transmit buffer queue. After i« is determined a, step 760 that a, leas, one block of space ,s 
3 available a, the associated transmit buffer queue, the pmcess proceeds to 762 a. which the outpn 
qU euing control unit 270 (FIG. 3A) reads the source device ID va,uc associated wfth the selected 
da ,a packe. from the packet location information unit 272 (FIG. 3A) to determine whether Ore 
source device associated with the selected packet is remote from the destination dev.ee. If it ts 



determined at 762 that the irce device associated with the selecte ata packet is not remote, the 
process proceeds to "A" (to FIG. IOC) as further explained below. Alternatively, if it is determined 
at 762 that the source device is remote, the process proceeds to step 764 in which the control nng 
message processing unit 170 (FIG. 3A) receives the patrol message 600 (FIG. 6). In step 766, the 
control ring message processing unit 170 (FIG. 3B) reads the current bandwidth parameter values of 
the patrol message 600 (FIG. 6) to determine the current amount of bandwidth resources m 
corresponding ones of the data ring segments 18 (FIG. 1) disposed in a path between the source 
device and destination device associated with the selected data packet, and also reads the current 
bandwidth parameter values associated with the memory unit 102, 104 (FIG. 2A) at which the- 
selected data packet is stored. In step 766, the control ring message processing unit 170 (FIG. 3A) 
reads the bandwidth parameter fields of the second and third cycle strings 620 and 630 (FIG. 6) of 
the patrol message. From step 766, the process proceeds to "B" (to FIG. 10B). 

FIG 10B shows a flow diagram illustrating further steps of the destination arbitration 
process 750 (FIG. lOA). The depicted process proceeds from "B" (from FIG. 10A) to 772 at which 
the control ring message processing unit 170 (FIG. 3A) determines whether a minimum amount of 
required bandwidth resources is available for transfer of the selected data packet from the source 
device is the destination device via a corresponding source destination channel path. The required 
amount of bandwidth resources for transfer of the selected packet from the corresponding packet 
buffer 100 (FIG. 3A) of the corresponding source one of the switching devices to the destination 
one of the transmit buffer queues 80 (FIG. 3 A) or 1 10 (FIG. 3B) is determined based on the type of 
network output port, and the network link 15 and 30 (FIG. 1) to which the destination network 
output port is connected. For example, if the destination network port associated with the selected 
data packet is connected to a 100 Mbps link, the control ring message processing unit 170 (FIG. 3A) 
reads the device link bandwidth fields 622, 624, 626, 628 (FIG. 6) of the patrol message to 
determine if each of the data ring segments 18 (FIG. 1), disposed between the corresponding source 
and destination devices, currently has at least 100 Mbps of bandwidth available, and also reads the 
memory unit link bandwidth fields 632-646 (FIG. 6) to determine of the memory unit link 103, 105 
(FIG. 2A) associated with the corresponding source device currently has at least 100 Mbps of 
bandwidth available. 

If it is determined at 772 that a minimum required amount of resources are not available for 
transfer of the selected packet, the process waits until the patrol message 600 (FIG. 6) propagates 
around the data ring of the switching fabric 10 (FIG. 1) back to the destination device associated 
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with the selected packet, a repeats the determination at 772 until minimum amount of 
bandwidth resources becomes available after which the process proceeds to step 774. 

In step 774, the control ring message processing unit 170 (FIG. 3A) adjusts corresponding 
ones of the bandwidth parameter values of the patrol message 600 (FIG. 6), and transmits the patrol 
message to the next device via the data ring. As mentioned above, the control ring message 
processing unit 170 (FIG. 3A) is operative to read and adjust each of the data ring channel 
bandwidth values carried by the patrol message in accordance with a channel rate reservation 
process. The control ring message processing unit is operative to: increase selected ones of the data 
ring channel bandwidth values by one upon allocating 100 Mbps of bandwidth for a corresponding 
channel; and decrease selected ones of the data ring channel bandwidth values by one upon 
releasing 100 Mbps of bandwidth from a corresponding channel. In accordance with the channel 
rate reservation process, if the capacity of the destination network port is greater than 100 Mbps, 
and the maximum allowable channel rate is not reached, the control ring message processing umt 
170 (FIG 3A) attempts to reserve additional channel bandwidth for the associated source- 
destination channel path each time the patrol message is received by the destination device before 
the current packet transfer operation is complete. After a last burst of packet data is received via the 
associated source-destination channel path, the bandwidth parameter values of the patrol message 
600 (FIG. 6), that associated with the source-destination channel path, are adjusted to return the 

previously allocated bandwidth. 

From step 774, the process proceeds to step 776 in which the output queuing control unit 
270 (FIG 3 A) determines an initial channel rate value for a corresponding source-destination 
channel for transferring the selected data packet from the packet buffer 1 00 (FIG. 3 A) of the source 
device to the destination network output port of the destination device. The initial channel rate 
value is determined by reading the patrol message 600 (FIG. 6) and also by considering the 
bandwidth capacity of the network output port. Note that the channel transfer rate may be xncreased 
in steps of 100 Mbps. If the destination network port is a 1 Gbps output port, and if less than 1 
Gbps of bandwidth is available, then a channel will be set up for 100 Mbps and the channel will be 
subsequently increased by the incremental rate transfer message (IRT message) 520 (FIG. 4E). 

In step 778, the output buffer manager 244 (FIG. 3A) of the destination device determines 
an initial credit value based on the number of blocks of available memory space in the 
corresponding destination one of the transmit buffer queues 80 (FIG. 3A) or 1 10 (FIG. 3B) as 
described above with reference to field 494 (FIG. 4C) of the PTN message. 
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In step 780, the cor ,1 ring message processing unit 170 de ops a paeke, transfer 
notation message (PTN message) in response ,0 paeke, transfer information ineluding: the 
destination deviee ID value assoeiated witir the selected paeke, received from per, 276 of tire outpu, 
queuing control nni, 270 (FIG. 3 A); the scarce device ID valne associated wim the selected da,a 
paeke, received from me ou,pn, queuing control nni, 270 (FIG. 3A); paeke, !oca,ion poin,er 
information associated wim the selected dam paeke, and received a, the control ring message 
processing nni, .70 (FIG. 3A) from me paeke, .ocation information nni, 272 of «he ou,pu, queutng 
contro. nni,; ,he initial transfer ra,e valne associated with ,he selected date paeke, received from the 
output bnffer manager 244 (FIG. 3A); and ,he initial eredi, valne received from port 254 of tire data 
distention control nni, 240 (FIG. 3 A). The PTN message 470 (FIG. 4C) is transmitted by the 
control ring inlerface and processing unit 60 (FIG. 3A) of tire destination device to tire source 
device associated with tire seleclcd data paeke, via tire control ring of tire paeke, switching fabne 10 

(FIG 'fIG 10C shows a flow diagram illustrating further steps of the destination deviee arbitration 
> process 750 (FIG. 10A). The depicted process proceeds from "A" (from FIG. 10A) ,o step 792 in 
which tire local ontpu, queuing con,rol uni, 270 (FIG. 3A) provides paeke, transfer notificatton 
information to the source managing uni. 90 (FIG. 3A) of tire local switching device, the mformarion 
including tire associated packet iocation pointer information, initial transfer rate valne, and the 
initial credi, value for a local paeke, transfer operation for transferring tire selected paeke, from tire 
.0 paeke, buffer 100 (FIG. 3 A) ,o the dam distribution control uni, 240 (FIG. 3A) via the FIFO 330 
(FIG 3 A) to the destination network port via the corresponding transmit buffer qneue. 

FIG 1 1 A shows a flow diagram illusteating a source device source process mtt.ated m 
response ,0 receiving a PTN message 470 (FIG. 4C). The process 800 begins with step 802 m 
which ,he control ring message processing nni. 170 (FIG. 3A) of a source one of the swrtetang 
25 devices 12 and 30 (FIG. 1) receives a PTN message via me comrol ring 25 (FIG. 1). From step 802 
the process proceeds to 804 a, which me control ring message processing urn. 170 (FIG. 3A) 
determines whetiter tire destination deviee ID vahre, carried by fields 474 and 478 (F.G. 4C) of me 
PTN message, matches tire local deviee ID value, and if so, the process proceeds to step 806 m 
which tire PTN message is terminated by .he control ring message processing un«, and an error ts 

30 reported, after which the process ends. 

Alternatively, if i, is determined at 804 tita, tire destination ID value carried by me PTN 
message matches the local device ID value, the process proceeds to 808 a. which the control rrng 
message processing unit 1 70 (FIG. 3A) determines whetirer the source ID valne, earned by field 



480 (FIG 4C) of the PTN ssage 470, matches tire local device II Hue, and if not, the process 
proceeds to step 8.0 in which the PTN message is propagated to the next downstream one of the 
devices via the control ring 25 (FIG. 1) without modification, after which the process ends. 
Alternatively, if it is determined a. 808 that the source ID value carried by the PTN message 
matches the local device ID value, the process proceeds to step 812 in which the control nng 
message processing uni, 170 (FIG. 3 A) reads the fields of me PTN message 470 (FIG. 4C) 

In step 814, the source channel control unit 318 (FIG. 3A) of the source device recetves the 
destination ID value carried by fields 474 and 478 (FIG. 4C) of Ore PTO message from ,he control 
ring message processing uni, .70 (FIG. 3A), and stores the destination ID value in a selected one of 
the channel destination ID registers 370 (FIG. 3C) associated with a corresponding channel for 
transferring the selected packet from tire source device to the corresponding destination dev.ee. 

In step 816 the source channel control unit 318 (FIG. 3A) initializes a correspondtng one of 
the chamre. credit court, registers 372 (FIG. 3C) associated with tire corresponding channel to tire 
initial credit vahre received via fields 494 (FIG. 4C) of tire received PTN message. In step 8.8, tire 
source channel control uni. 3.8 (FIG. 3A) initializes a corresponding one of tire channel rate 
registers 375 (FIG. 3C) to the initial channel rate value received via field 496 (FIG. 4C) of .he PTN 
message In step 820, tire source channel control unit 318 (FIO. 3A) stores tire packet locatton 
pointer information received via fields 488 and 492 (FIG. 4C) of tire PTN message in the 
correspondtng one of the pointer information registers 374 (FIG. 3C) associated with the 
corresponding channel. In step 822, the source channel control urn. 318 (FIG. 3A) provrdes tire 
channel date transfer signals a. its port 324 to pot 342 of tire packet buffer control um. 340 (FIG. 
3A) causing tire packet buffer control uni. to access the selected date packet stored in the packet 
buffer 100 (FIG. 3A) which is indicated by the packet location pointer information received vta the 
corresponding PTN message. From step 822, tire process proceeds to »C» (to FIG. 1 IB). 

FIG 1 IB shows a flow diagram illustrating further steps at 830 of the source devtce process 
800 (FIG 1 1 A). The depicted process proceeds from »C» (from FIG. 1 1 A) to step 832 in which the 
data ring transmitting uni. 216 (FIG. 3A) transfers a firs, burs, of the selected date pack., vta the 
date ting, fn step 832, the data ring transmitting uni. receives tire date packet from the packet buffer 
.00 (FIG 3A) via the FIFO 330 a. its inpu, port 224. Note tha, in step 832, tire packet routing and 
contiol uni. 302 (FIG. 3A) which is coupled to tire FIFO 330 via node 335 is operative ,0 append 
the bursts of the selected date packe, with a destination ID value so that the bursts of date packe, 
can be received at the associated destination device. 
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In step 834 the cht el rate timer 368 (FIG. 3C) of the som channel control unit 318 
(FIG 3 A) is initialized to run in accordance with the initial channel rate value received via the PTN 
Lsage and stored in the corresponding one of the channel rate registers 370 (FIG. 3C) as indicated 
in step 818 (FIG. 1 1 A). As described above, the initial channel rate value indicated a penod winch 
the source managing unit 90 (FIG. 3 A) waits between transmitting bursts of the selected data packet 
in accordance with the available bandwidth resources associated with the corresponding source 
destination channel path for transmitting the selected data packets as determined by the destination 
device in step 776 (FIG. 10B) of the destination device process. From step 834, the process 
proceeds to step 835 in which the source channel control unit 318 (FIG. 3A) decrements the channel 
credit value stored in the associated credit count register 372 (FIG. 3A) by one in response to the 
burst of the selected data packet being transferred. 

From step 835, the process proceeds to 836 at which the source channel control umt 318 
(FIG 3 A) determines whether the last burst of the selected data packet has been transmitted, and if 
so the process proceeds to step 838 in which each of the set of registers of the associated channel 
parameter memory unit 366 (FIG. 3C), associated with the selected data packet is cleared, after 
which the process ends. Alternatively, if it is determined at 836 that the last burst of the selected 
data packet has not been transferred, the process proceeds to 840 at which the source channel 
control unit 318 (FIG. 3A) reads the contents of the credit count register 372 (FIG. 3C) associated 
with the corresponding channel to determine if the contents of the channel credit count is equal to 
zero, and if so, the process proceeds to "D" (to FIG. 12) in which the source device warts for a 
corresponding ICT message 500 (FIG. 4D). 

Alternatively, if it is determined at 840 that the channel credit count value is not equal to 
zero the process proceeds to step 842 in which the source channel control unit 318 (FIG. 3A) 
instructs the packet buffer control unit 340 (FIG. 3A) to transfer the next burst of the selected data 
packet from the packet buffer 1 00 to the data ring processing unit 66 (FIG. 3 A) at a time indicated 
by the corresponding one of the channel rate timers 368 (FIG. 3C), after which the process 830- 

ends. . 
FIG 12 shows a flow diagram illustrating a source device behavior process at 850 which is 

initiated in response to receiving an ICT message 500 (FIG. 4D). The depicted process proceeds 

, from "D» (from FIG. 1 IB) and proceeds to step 852 in which the control ring message processing 

unit 170 (FIG. 3A) of the source device receives an ICT message 500 (FIG. 4D) via the control ring. 

From step 852, the process proceeds to 854 at which the control ring message processing unit 170 

(FIG. 3A) determines whether the destination ID value, carried by fields 504 and 5 10 (FIG. 4D) of 



the ICT message, matches , local device ID value, and if so, the P ;ess proceeds to step 856 in 
which the ICT message is terminated, and an error is reported, after which the process ends. 
Alternatively, if it is determined at 854 that the ICT message is not destined for the local device, the 
process proceeds to 858 at which the control ring message processing unit 170 (FIG. 3 A) 
determines whether the destination ID value, carried by fields 504 and 510 (FIG. 4D) of the ICT 
message, matches the value stored in any of the local channel destination ID registers 370 (FIG. 3C) 
of the source channel control unit of the source device, and if not, the process proceeds to step 860 
in which the ICT message is propagated without modification via the control ring. Alternatively if 
it is determined at 858 that the received ICT message is associated with a channel previously 
established at the local source device, that is the destination ID value carried by the ICT message 
matches a destination ID value stored in one of the destination ID registers 370 (FIG. 3C) of the 
source device, then the process proceeds to step 862 in which the control ring message processing 
unit 170 (FIG. 3A) reads the values carried by the ICT message 500 (FIG. 4D) including the 
destination ID value and incremental credit value. From step 864, the process proceeds to step 864 
in which the source channel control unit 3 1 8 (FIG. 3A) increases the associated one of the channel 
credit value stored in the associated one of the channel credit count registers 372 (FIG. 3C) by the 
incremental credit value carried by field 508 (FIG. 4D) of the received ICT message. From step 
864, the process proceeds to "E" (back to FIG. 1 IB). 

FIG. 13 shows a flow diagram illustrating a device source process at 870 that initiated in 
response to receiving an IRT message 520 (FIG. 4E). The process begins with step 872 in which 
the control ring message processing unit 170 (FIG. 3 A) receives an IRT message via the control 
ring. From step 872, the process proceeds to 874 which the control ring message processing unit 
compares the destination ID value carried by fields 524 and 530 (FIG. 4E) of the IRT message to 
the local device ID value, and if there is a match, the process proceeds to step 876 in which the 
control ring message processing unit terminates the IRT message, and reports an error after which 
the process ends. 

Alternatively, if it is determined at 874 that the destination ID value carried by the IRT 
message does not match the local device ID value, the process proceeds to 878 at which the control 
ring message processing unit 170 (FIG. 3 A) determines whether the received destination device ID 
matches a value stored in any of the local channel destination ID registers 370 (FIG. 3C) of the 
source device, and if not, the process proceeds to step 880 in which the IRT message is propagated 
via the control ring without modification. 
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A1 ,emarive, y ,ifit. a^SthatthedestmaUon. ^ cToT 

IRT message matches a value stored in one of the destination ID regtsters 370 (FIG. 3C of .to 
Lee devl, the process proceeds to step 882 in which the sotnce charme! eontrol urn, 3 1 8 (FIG. 
r A )ll the IRT message inCuding me destination ID vahre and increment rate va^e carrred m 
«1 S 8 (FIG. 4E, of Ore IRT message. From step 882, the process proceeds ,o step 884 ,n whtch 

rate registers 375 (FIG. 3C) associated with the corresponding one of me channel bv 

urease the corresponding chamre, rate. From step 884, me process proceeds hack ,o G (back to 

FIQ ' ' 'lough the present invention has heen particmariy shown and described above with 
Terence ro a peciftc embodiment, it is anticipated ma, alterations and modifications : tbereof w„l 
rodonbtbecomeapparenttoriroseskinedinmeart. « is therefore infcnderi tha, the followmg 



and scope of the invention, 
What is claimed is: 
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